Jul 23 03:11:22 devstack cinder-volume[77263]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:11:22 devstack cinder-volume[77263]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:11:22 devstack cinder-volume[77263]: we strongly recommend against using it for new projects. Jul 23 03:11:22 devstack cinder-volume[77263]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:11:22 devstack cinder-volume[77263]: framework. For more detail see Jul 23 03:11:22 devstack cinder-volume[77263]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:11:22 devstack cinder-volume[77263]: import eventlet # noqa Jul 23 03:11:25 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:11:25 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:11:25 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:11:26 devstack cinder-volume[77263]: INFO dbcounter [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Registered counter for database cinder Jul 23 03:11:26 devstack cinder-volume[77263]: DEBUG oslo_db.sqlalchemy.engines [None req-811eef36-3527-471e-8257-f650067dfdcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:26 devstack cinder-volume[77263]: DEBUG dbcounter [-] [77263] Writer thread running {{(pid=77263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:26 devstack cinder-volume[77263]: INFO cinder.rpc [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:11:26 devstack cinder-volume[77263]: INFO cinder.rpc [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:11:26 devstack cinder-volume[77263]: DEBUG oslo_db.sqlalchemy.engines [None req-811eef36-3527-471e-8257-f650067dfdcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:27 devstack cinder-volume[77263]: INFO cinder.volume.manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Determined volume DB was empty at startup. Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG cinder.volume.manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77263) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:11:27 devstack cinder-volume[77263]: INFO cinder.volume.manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:11:27 devstack cinder-volume[77263]: WARNING stevedore.named [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:27 devstack cinder-volume[77263]: WARNING castellan.key_manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:27 devstack cinder-volume[77263]: WARNING cinder.keymgr.conf_key_mgr [None req-811eef36-3527-471e-8257-f650067dfdcc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG cinder.volume.drivers.lvm [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77263) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_concurrency.processutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_concurrency.processutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] CMD "cinder-rtstool verify" returned: 0 in 0.531s {{(pid=77263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_db.sqlalchemy.engines [None req-811eef36-3527-471e-8257-f650067dfdcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:27 devstack cinder-volume[77263]: INFO cinder.rpc [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 03:11:27 devstack cinder-volume[77263]: INFO cinder.rpc [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 23 03:11:27 devstack cinder-volume[77263]: WARNING stevedore.named [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:27 devstack cinder-volume[77263]: WARNING castellan.key_manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:27 devstack cinder-volume[77263]: INFO cinder.volume.manager [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_db.sqlalchemy.engines [None req-811eef36-3527-471e-8257-f650067dfdcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:27 devstack cinder-volume[77263]: INFO oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Starting 1 workers Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Started child 77530 {{(pid=77263) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Full set of CONF: {{(pid=77263) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] ******************************************************************************** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Configuration options gathered from: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] ================================================================================ {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] allow_availability_zone_fallback = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] allow_compression_on_image_upload = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] allowed_direct_url_schemes = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] api_rate_limit = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] auth_strategy = keystone {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] az_cache_duration = 3600 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_availability_zone = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_host = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_stats_polling_interval = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backup_api_class = cinder.backup.api.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77530]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backup_name_template = backup-%s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backup_use_same_host = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backup_use_temp_snapshot = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] chap_password = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] chap_username = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_internal_tenant_project_id = 46582662164a41afb8687acc0a4497f3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_internal_tenant_user_id = 5eba050de6f24299a86b0e421c87ce5c {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cloned_volume_same_az = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cluster = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] compression_format = gzip {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] compute_api_class = cinder.compute.nova.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] config_dir = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] config_source = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] control_exchange = openstack {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] debug = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] default_availability_zone = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] default_group_type = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] default_volume_type = lvmdriver-1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] disk_geometry = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_client_cert = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_client_cert_key = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_data_namespace = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_ssl_cert_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_ssl_cert_verify = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] driver_use_ssl = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] enable_force_upload = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] enable_new_services = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] enable_unsupported_driver = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] enabled_backends = ['lvmdriver-1'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] enforce_multipath_for_image_xfer = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] filter_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_api_insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_api_ssl_compression = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_ca_certificates_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_catalog_info = image:glance:publicURL {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_num_retries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance_request_timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] goodness_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] graceful_shutdown_timeout = 5 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] group_api_class = cinder.group.api.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] host = devstack {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_compress_on_upload = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_conversion_address_space_limit = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_conversion_cpu_limit = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_conversion_disable = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_upload_use_cinder_backend = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_upload_use_internal_tenant = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_volume_cache_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_volume_cache_max_count = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] image_volume_cache_max_size_gb = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] init_host_max_objects_retrieval = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] instance_format = [instance: %(uuid)s] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iscsi_target_flags = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iscsi_write_cache = on {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iser_helper = tgtadm {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iser_ip_address = 192.168.122.205 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iser_port = 3260 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_color = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_config_append = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_dir = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_options = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_rotate_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_rotate_interval_type = days {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] log_rotation_type = none {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] max_age = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] max_logfile_count = 30 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] max_logfile_size_mb = 200 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77530]: INFO cinder.volume.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] max_over_subscription_ratio = 20.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] message_reap_interval = 86400 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] message_ttl = 2592000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] migration_create_volume_timeout_secs = 300 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] monkey_patch = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] monkey_patch_modules = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] my_ip = 192.168.122.205 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] no_snapshot_gb_quota = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] num_iser_scan_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] num_shell_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] num_volume_device_scan_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] nvmeof_conn_info_version = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] nvmet_ns_id = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] nvmet_port_id = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_max_limit = 1000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_ext_list = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_listen = 0.0.0.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_listen_port = 8776 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_use_ssl = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] osapi_volume_workers = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] per_volume_size_limit = -1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] periodic_fuzzy_delay = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] periodic_interval = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] project_id_regex = [0-9a-f\-]+ {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] public_endpoint = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] publish_errors = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_backup_gigabytes = 1000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_backups = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_gigabytes = 1000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_groups = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_snapshots = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] quota_volumes = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] rate_limit_burst = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] rate_limit_except_level = CRITICAL {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] rate_limit_interval = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] reinit_driver_count = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] replication_device = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] report_discard_supported = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] report_interval = 120 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] reservation_clean_interval = 86400 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] reservation_expire = 86400 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] reserved_image_namespaces = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] reserved_percentage = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] rpc_response_timeout = 120 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] run_external_periodic_tasks = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] scst_target_driver = iscsi {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] scst_target_iqn_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_down_time = 720 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] shell_completion = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] snapshot_name_template = snapshot-%s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] snapshot_same_host = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] split_loggers = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] state_path = /opt/stack/data/cinder {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] storage_availability_zone = nova {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] storage_protocol = iSCSI {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] syslog_log_facility = LOG_USER {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_helper = lioadm {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_ip_address = 192.168.122.205 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_port = 3260 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_protocol = iscsi {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] target_secondary_ip_addresses = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] trace_flags = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] transfer_api_class = cinder.transfer.api.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] transport_url = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] until_refresh = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_chap_auth = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_default_quota_class = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_journal = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_json = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_multipath_for_image_xfer = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_stderr = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] use_syslog = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] verify_glance_signatures = enabled {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_api_class = cinder.volume.api.API {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_backend_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_clear = zero {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_clear_ionice = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_clear_size = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_copy_bps_limit = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_dd_blocksize = 1M {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_name_template = volume-%s {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_service_inithost_offload = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volume_usage_audit_period = month {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] zoning_mode = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_concurrency.disable_process_locking = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.auth_section = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.auth_type = password {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.auth_version = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.cache = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.delay_auth_decision = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.http_connect_timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.include_service_catalog = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.interface = public {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_password = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcache_username = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.region_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.service_token_roles_required = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.service_type = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.token_cache_time = 300 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.backend = dogpile.cache.null {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.backend_argument = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.backend_expiration_time = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.config_prefix = cache.oslo {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.debug_cache_backend = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.enable_retry_client = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.enable_socket_keepalive = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.expiration_time = 600 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.hashclient_retry_attempts = 2 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_dead_retry = 300 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_pool_maxsize = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_sasl_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.password = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.proxies = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.redis_db = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.redis_sentinel_service_name = mymaster {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.redis_server = localhost:6379 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.retry_attempts = 2 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.retry_delay = 0.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.socket_keepalive_count = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.socket_keepalive_idle = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.socket_keepalive_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.socket_timeout = 1.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.tls_allowed_ciphers = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.tls_cafile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.tls_certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.tls_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.tls_keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cache.username = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] coordination.backend_url = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.asyncio_connection = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.asyncio_slave_connection = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.backend = sqlalchemy {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.connection = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.connection_debug = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.connection_parameters = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.connection_recycle_time = 3600 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.connection_trace = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.db_inc_retry_interval = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.db_max_retries = 20 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.db_max_retry_interval = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.db_retry_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.max_overflow = 50 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.max_pool_size = 5 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.max_retries = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.mysql_wsrep_sync_wait = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.pool_timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.retry_interval = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.slave_connection = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.sqlite_synchronous = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.synchronous_reader = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] database.use_db_reconnect = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.connection_string = messaging:// {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.es_doc_type = notification {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:27 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.es_scroll_size = 10000 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.es_scroll_time = 2m {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.filter_error_trace = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.hmac_keys = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.sentinel_service_name = mymaster {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.socket_timeout = 0.1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.trace_requests = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler.trace_sqlalchemy = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler_jaeger.process_tags = {} {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler_jaeger.service_name_prefix = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] profiler_otlp.service_name_prefix = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.enforce_new_defaults = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.policy_default_rule = default {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.policy_file = policy.yaml {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_policy.remote_timeout = 60.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.group = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.helper_command = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] privsep_osbrick.user = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.group = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.helper_command = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] cinder_sys_admin.user = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.auth_section = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.auth_type = password {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.cafile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.collect_timing = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.send_service_user_token = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.split_loggers = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] service_user.timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.auth_section = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.auth_type = password {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.collect_timing = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.region_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.split_loggers = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] glance.timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.backend_availability_zone = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.chap_password = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.chap_username = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.disk_geometry = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_client_cert = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_client_cert_key = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_data_namespace = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.driver_use_ssl = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.enable_unsupported_driver = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.extra_capabilities = {} {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.filter_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.goodness_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iscsi_target_flags = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iscsi_write_cache = on {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iser_helper = tgtadm {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iser_port = 3260 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.lvm_mirrors = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.lvm_share_target = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.lvm_type = auto {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.num_shell_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.nvmet_port_id = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.replication_device = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.report_discard_supported = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.reserved_percentage = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.scst_target_driver = iscsi {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.scst_target_iqn_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.storage_protocol = iSCSI {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_helper = tgtadm {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_port = 3260 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_protocol = iscsi {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.trace_flags = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.unique_fqdn_network = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.use_chap_auth = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_backend_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_clear = zero {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_clear_ionice = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_clear_size = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volume_group = cinder-volumes {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_reports.file_event_handler = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_reports.log_dir = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.backend_availability_zone = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.backend_host = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.chap_password = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.chap_username = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.chiscsi_conf = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.disk_geometry = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_client_cert = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_data_namespace = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.driver_use_ssl = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.extra_capabilities = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.filter_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.goodness_function = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iser_helper = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iser_ip_address = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iser_port = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.iser_target_prefix = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.lvm_conf_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.lvm_mirrors = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.lvm_share_target = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.lvm_type = auto {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.num_shell_tries = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.nvmet_port_id = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.replication_device = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.report_discard_supported = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.reserved_percentage = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.scst_target_driver = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.storage_protocol = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_helper = lioadm {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_ip_address = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_port = 3260 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_protocol = iscsi {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.trace_flags = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.use_chap_auth = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_clear = zero {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_clear_size = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] lvmdriver-1.volumes_dir = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.ssl_version = {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_notifications.driver = [] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_notifications.retry = -1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] oslo_messaging_notifications.transport_url = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] key_manager.fixed_key = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.barbican_api_version = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.barbican_endpoint = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.barbican_endpoint_type = public {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.barbican_region_name = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.cafile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.collect_timing = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.number_of_retries = 60 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.retry_delay = 1 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.send_service_user_token = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.split_loggers = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.verify_ssl = True {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican.verify_ssl_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.auth_section = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.auth_type = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.cafile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.certfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.collect_timing = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.insecure = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.keyfile = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.split_loggers = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] barbican_service_user.timeout = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.approle_role_id = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.approle_secret_id = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.auth_method = approle {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.auth_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.kv_mountpoint = secret {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.kv_path = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.kv_version = 2 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.namespace = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.root_token_id = **** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.ssl_ca_crt_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.timeout = 60.0 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.token_file = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.token_role = None {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.use_ssl = False {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:28 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] ******************************************************************************** {{(pid=77263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:11:28 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[77662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:28 devstack sudo[77662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[77662]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.264s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:11:28 devstack cinder-volume[77530]: INFO cinder.brick.local_dev.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[77753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:28 devstack sudo[77753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[77753]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG cinder.brick.local_dev.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77530) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 23 03:11:28 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[77840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:28 devstack sudo[77840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[77840]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.541s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:30 devstack sudo[78130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78130]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 23 03:11:30 devstack sudo[78214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78214]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.286s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78217]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78220]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78229]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:31 devstack sudo[78232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78232]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:32 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: INFO cinder.volume.drivers.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:32 devstack sudo[78240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78240]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:32 devstack sudo[78244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78244]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:32 devstack sudo[78249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:33 devstack sudo[78249]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:33 devstack sudo[78252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:33 devstack sudo[78252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:33 devstack sudo[78252]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:33 devstack sudo[78255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:33 devstack sudo[78255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:33 devstack sudo[78255]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:33 devstack cinder-volume[77530]: INFO cinder.volume.driver [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG cinder.volume.driver [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77530) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_db.sqlalchemy.engines [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writer thread running {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG cinder.db.api [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Building query based on filter {{(pid=77530) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG cinder.image.image_utils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77530) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:11:33 devstack cinder-volume[77530]: INFO cinder.keymgr.migration [None req-6dc89a64-9aac-434e-880f-8c42c482e8e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:33 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:33 devstack sudo[78260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:33 devstack sudo[78260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78260]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:34 devstack sudo[78263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78263]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:34 devstack sudo[78266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78266]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:34 devstack sudo[78274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78274]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77530]: DEBUG cinder.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Notifying Schedulers of capabilities ... {{(pid=77530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:11:35 devstack cinder-volume[77530]: INFO cinder.volume.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Driver initialization completed successfully. Jul 23 03:11:35 devstack cinder-volume[77530]: INFO cinder.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Initiating service 2 cleanup Jul 23 03:11:35 devstack cinder-volume[77530]: INFO cinder.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Service 2 cleanup completed. Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG cinder.service [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Creating RPC server for service cinder-volume {{(pid=77530) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG cinder.service [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77530) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:11:35 devstack cinder-volume[77530]: INFO cinder.volume.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:35 devstack sudo[78277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:35 devstack sudo[78277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:35 devstack sudo[78277]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:35 devstack sudo[78284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:35 devstack sudo[78284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:35 devstack sudo[78284]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:35 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:35 devstack sudo[78289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:35 devstack sudo[78289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:36 devstack sudo[78289]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:36 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.351s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:36 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:36 devstack sudo[78382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:36 devstack sudo[78382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:36 devstack sudo[78382]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:36 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:36 devstack cinder-volume[77530]: INFO cinder.volume.manager [None req-07b2e14d-7e8a-4dea-9faa-5191e530e680 None None] Driver post RPC initialization completed successfully. Jul 23 03:11:37 devstack cinder-volume[77263]: DEBUG dbcounter [-] [77263] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:46 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:46 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:12:19 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager._thread_info {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:12:19 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread count: 6 {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:12:19 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread info: [<_MainThread(MainThread, started 132911764496512)>, , , , , ] {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:19 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:13:19 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:19 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:19 devstack sudo[83477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:19 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:19 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:19 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:13:19 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:20 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:20 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:20 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:20 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG cinder.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Notifying Schedulers of capabilities ... {{(pid=77530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager._thread_info {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread count: 6 {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:13:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread info: [<_MainThread(MainThread, started 132911764496512)>, , , , , ] {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:13:46 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writing DB stats cinder:SELECT=1 {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:13:46 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writing DB stats cinder:UPDATE=1 {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:19 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:14:19 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:19 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:19 devstack sudo[85264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:19 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:19 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:19 devstack sudo[85268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:14:19 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:20 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:20 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:20 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:20 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG cinder.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Notifying Schedulers of capabilities ... {{(pid=77530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager._thread_info {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread count: 6 {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:14:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread info: [<_MainThread(MainThread, started 132911764496512)>, , , , , ] {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG cinder.volume.drivers.lvm [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Updating volume stats {{(pid=77530) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:19 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:15:19 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:19 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:19 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:19 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:19 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:19 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:19 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:15:19 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:20 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:20 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:20 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:20 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG oslo_concurrency.processutils [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG cinder.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Notifying Schedulers of capabilities ... {{(pid=77530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG oslo_service.periodic_task [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] Running periodic task VolumeManager._thread_info {{(pid=77530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread count: 6 {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:15:20 devstack cinder-volume[77530]: DEBUG cinder.volume.manager [None req-b326daaf-15da-4feb-9be4-95119c330d3a None None] thread info: [<_MainThread(MainThread, started 132911764496512)>, , , , , ] {{(pid=77530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:15:46 devstack cinder-volume[77530]: DEBUG dbcounter [-] [77530] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:15:58 devstack cinder-volume[77263]: INFO oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Caught SIGTERM, stopping children Jul 23 03:15:58 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Acquiring lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:58 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Acquired lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:58 devstack cinder-volume[77263]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Releasing lock "singleton_lock" {{(pid=77263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:58 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Stop services. {{(pid=77263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:15:58 devstack cinder-volume[77263]: DEBUG oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Killing children. {{(pid=77263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:15:58 devstack cinder-volume[77263]: INFO oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Waiting on 1 children to exit Jul 23 03:16:00 devstack cinder-volume[77530]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Acquiring lock "singleton_lock" {{(pid=77530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:00 devstack cinder-volume[77530]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Acquired lock "singleton_lock" {{(pid=77530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:00 devstack cinder-volume[77530]: DEBUG oslo_concurrency.lockutils [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Releasing lock "singleton_lock" {{(pid=77530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:00 devstack cinder-volume[77530]: WARNING amqp [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:00 devstack cinder-volume[77530]: WARNING amqp [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:00 devstack cinder-volume[77263]: INFO oslo_service.backend._eventlet.service [None req-811eef36-3527-471e-8257-f650067dfdcc None None] Child 77530 exited with status 0 Jul 23 03:16:00 devstack cinder-volume[87506]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:16:00 devstack cinder-volume[87506]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:16:00 devstack cinder-volume[87506]: we strongly recommend against using it for new projects. Jul 23 03:16:00 devstack cinder-volume[87506]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:16:00 devstack cinder-volume[87506]: framework. For more detail see Jul 23 03:16:00 devstack cinder-volume[87506]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:16:00 devstack cinder-volume[87506]: import eventlet # noqa Jul 23 03:16:02 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:02 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:02 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:03 devstack cinder-volume[87506]: INFO dbcounter [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Registered counter for database cinder Jul 23 03:16:03 devstack cinder-volume[87506]: DEBUG oslo_db.sqlalchemy.engines [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:03 devstack cinder-volume[87506]: DEBUG dbcounter [-] [87506] Writer thread running {{(pid=87506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:03 devstack cinder-volume[87506]: INFO cinder.rpc [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:16:03 devstack cinder-volume[87506]: INFO cinder.rpc [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:16:03 devstack cinder-volume[87506]: DEBUG oslo_db.sqlalchemy.engines [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:03 devstack cinder-volume[87506]: INFO cinder.volume.manager [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Determined volume DB was empty at startup. Jul 23 03:16:03 devstack cinder-volume[87506]: DEBUG cinder.volume.manager [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87506) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:16:03 devstack cinder-volume[87506]: INFO cinder.volume.manager [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:16:03 devstack cinder-volume[87506]: WARNING stevedore.named [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:16:03 devstack cinder-volume[87506]: WARNING castellan.key_manager [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:03 devstack cinder-volume[87506]: WARNING cinder.keymgr.conf_key_mgr [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:03 devstack cinder-volume[87506]: INFO cinder.volume.manager [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_db.sqlalchemy.engines [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:04 devstack cinder-volume[87506]: INFO oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Starting 1 workers Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Started child 87720 {{(pid=87506) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Full set of CONF: {{(pid=87506) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] ******************************************************************************** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Configuration options gathered from: {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] ================================================================================ {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] allow_availability_zone_fallback = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] allow_compression_on_image_upload = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] allowed_direct_url_schemes = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] api_rate_limit = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] auth_strategy = keystone {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87720]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_availability_zone = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_host = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_stats_polling_interval = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backup_api_class = cinder.backup.api.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backup_name_template = backup-%s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backup_use_same_host = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backup_use_temp_snapshot = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] chap_password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] chap_username = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_internal_tenant_project_id = 46582662164a41afb8687acc0a4497f3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_internal_tenant_user_id = 5eba050de6f24299a86b0e421c87ce5c {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cluster = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] compression_format = gzip {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] compute_api_class = cinder.compute.nova.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] config_dir = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] config_source = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] control_exchange = openstack {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] debug = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] default_availability_zone = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] default_group_type = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] default_volume_type = QuobyteHD {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] disk_geometry = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_client_cert = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_client_cert_key = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_data_namespace = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_ssl_cert_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_ssl_cert_verify = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] driver_use_ssl = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] enable_new_services = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] enable_unsupported_driver = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] enabled_backends = ['QuobyteHD'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] enforce_multipath_for_image_xfer = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] filter_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_api_insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_api_ssl_compression = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_ca_certificates_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_catalog_info = image:glance:publicURL {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_num_retries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance_request_timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] goodness_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] graceful_shutdown_timeout = 5 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] group_api_class = cinder.group.api.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] host = devstack {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_compress_on_upload = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_conversion_address_space_limit = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_conversion_cpu_limit = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_conversion_disable = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_upload_use_cinder_backend = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_upload_use_internal_tenant = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_volume_cache_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_volume_cache_max_count = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] image_volume_cache_max_size_gb = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] init_host_max_objects_retrieval = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] instance_format = [instance: %(uuid)s] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iscsi_target_flags = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iscsi_write_cache = on {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iser_helper = tgtadm {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iser_ip_address = 192.168.122.205 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iser_port = 3260 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_color = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_config_append = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_dir = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_options = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87720]: INFO cinder.volume.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.remotefs [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87720) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_rotate_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_rotate_interval_type = days {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] log_rotation_type = none {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] max_age = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] max_logfile_count = 30 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] max_logfile_size_mb = 200 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] max_over_subscription_ratio = 20.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] message_reap_interval = 86400 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] message_ttl = 2592000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] migration_create_volume_timeout_secs = 300 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] monkey_patch = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] monkey_patch_modules = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] my_ip = 192.168.122.205 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] no_snapshot_gb_quota = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] num_iser_scan_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] num_shell_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] num_volume_device_scan_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] nvmeof_conn_info_version = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] nvmet_ns_id = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] nvmet_port_id = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_max_limit = 1000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_ext_list = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_listen_port = 8776 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_use_ssl = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] osapi_volume_workers = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] per_volume_size_limit = -1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] periodic_fuzzy_delay = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] periodic_interval = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] public_endpoint = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] publish_errors = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_backup_gigabytes = 1000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_backups = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_gigabytes = 1000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_groups = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_snapshots = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] quota_volumes = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] rate_limit_burst = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] rate_limit_except_level = CRITICAL {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] rate_limit_interval = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] reinit_driver_count = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] replication_device = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] report_discard_supported = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] report_interval = 120 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] reservation_clean_interval = 86400 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] reservation_expire = 86400 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] reserved_image_namespaces = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] reserved_percentage = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] rpc_response_timeout = 120 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] run_external_periodic_tasks = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] scst_target_driver = iscsi {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] scst_target_iqn_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_down_time = 720 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] shell_completion = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] snapshot_name_template = snapshot-%s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] split_loggers = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] state_path = /opt/stack/data/cinder {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] storage_availability_zone = nova {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] storage_protocol = iSCSI {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] syslog_log_facility = LOG_USER {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_helper = lioadm {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_ip_address = 192.168.122.205 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_port = 3260 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_protocol = iscsi {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] target_secondary_ip_addresses = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] trace_flags = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] transport_url = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] until_refresh = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_chap_auth = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_default_quota_class = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_journal = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_json = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_multipath_for_image_xfer = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_stderr = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] use_syslog = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] verify_glance_signatures = enabled {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_api_class = cinder.volume.api.API {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_backend_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_clear = zero {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_clear_ionice = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_clear_size = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_copy_bps_limit = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_dd_blocksize = 1M {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_name_template = volume-%s {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_service_inithost_offload = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volume_usage_audit_period = month {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] zoning_mode = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_concurrency.disable_process_locking = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.auth_section = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.auth_type = password {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.auth_version = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.cache = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.include_service_catalog = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.interface = public {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_password = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcache_username = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.region_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.service_type = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.backend = dogpile.cache.null {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.backend_argument = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.backend_expiration_time = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.config_prefix = cache.oslo {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.debug_cache_backend = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.enable_retry_client = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.enable_socket_keepalive = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.expiration_time = 600 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.hashclient_retry_attempts = 2 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_dead_retry = 300 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_pool_maxsize = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_sasl_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.proxies = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.redis_db = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.redis_server = localhost:6379 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.retry_attempts = 2 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.retry_delay = 0.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.socket_keepalive_count = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.socket_keepalive_idle = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.socket_keepalive_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.socket_timeout = 1.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.tls_allowed_ciphers = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.tls_cafile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.tls_certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.tls_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.tls_keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cache.username = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] coordination.backend_url = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.asyncio_connection = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.asyncio_slave_connection = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.backend = sqlalchemy {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.connection = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.connection_debug = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.connection_parameters = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.connection_recycle_time = 3600 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.connection_trace = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.db_inc_retry_interval = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.db_max_retries = 20 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.db_max_retry_interval = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.db_retry_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.max_overflow = 50 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.max_pool_size = 5 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.max_retries = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.mysql_wsrep_sync_wait = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.pool_timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.retry_interval = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.slave_connection = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.sqlite_synchronous = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.synchronous_reader = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] database.use_db_reconnect = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.connection_string = messaging:// {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.es_doc_type = notification {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.es_scroll_size = 10000 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.es_scroll_time = 2m {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.filter_error_trace = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.hmac_keys = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.sentinel_service_name = mymaster {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.socket_timeout = 0.1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.trace_requests = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler.trace_sqlalchemy = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler_jaeger.process_tags = {} {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler_jaeger.service_name_prefix = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] profiler_otlp.service_name_prefix = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.enforce_new_defaults = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.policy_default_rule = default {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87720) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.policy_file = policy.yaml {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: WARNING cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:16:04 devstack cinder-volume[87720]: WARNING cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Running cmd (subprocess): mount.quobyte {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.group = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.helper_command = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] privsep_osbrick.user = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.group = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.helper_command = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] cinder_sys_admin.user = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.auth_section = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.auth_type = password {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.cafile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.collect_timing = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.send_service_user_token = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.split_loggers = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] service_user.timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.auth_section = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.auth_type = password {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.collect_timing = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.region_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.split_loggers = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] glance.timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.backend_availability_zone = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.chap_password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.chap_username = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.disk_geometry = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_client_cert = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_client_cert_key = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_data_namespace = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.driver_use_ssl = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.extra_capabilities = {} {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.filter_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.goodness_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iscsi_target_flags = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iscsi_write_cache = on {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iser_helper = tgtadm {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iser_port = 3260 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_host = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_login = admin {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_mount_options = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_private_key = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_share_path = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.num_shell_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.quobyte_volume_url = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack quobyte-client[87725]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:16:04 devstack quobyte-client[87725]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.replication_device = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.report_discard_supported = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.reserved_percentage = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=87720) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87720]: INFO cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a ... Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 -c /etc/quobyte/client-cinder.cfg {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_helper = tgtadm {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_port = 3260 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_protocol = iscsi {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.trace_flags = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.unique_fqdn_network = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.use_chap_auth = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_backend_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_clear = zero {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_clear_ionice = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_clear_size = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_reports.file_event_handler = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_reports.log_dir = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.backend_availability_zone = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.backend_host = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.chap_password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.chap_username = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 -c /etc/quobyte/client-cinder.cfg Jul 23 03:16:04 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.chiscsi_conf = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.disk_geometry = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_client_cert = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_data_namespace = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.driver_use_ssl = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.extra_capabilities = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.filter_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.goodness_function = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iser_helper = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iser_ip_address = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iser_port = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.iser_target_prefix = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_host = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_login = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_mount_options = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_password = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_private_key = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_share_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_ssh_port = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.num_shell_tries = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.nvmet_port_id = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.replication_device = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.report_discard_supported = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.reserved_percentage = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.scst_target_driver = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.storage_protocol = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_helper = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_ip_address = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_port = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_prefix = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_protocol = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.trace_flags = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.use_chap_auth = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_clear = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_clear_size = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] QuobyteHD.volumes_dir = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_notifications.driver = [] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_notifications.retry = -1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] key_manager.fixed_key = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.barbican_api_version = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.barbican_endpoint = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.barbican_endpoint_type = public {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.barbican_region_name = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.cafile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.collect_timing = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.number_of_retries = 60 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.retry_delay = 1 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.send_service_user_token = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.split_loggers = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.verify_ssl = True {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican.verify_ssl_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.auth_section = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.auth_type = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.cafile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.certfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.collect_timing = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.insecure = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.keyfile = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.split_loggers = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] barbican_service_user.timeout = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.approle_role_id = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.approle_secret_id = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.auth_method = approle {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.auth_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.kv_mountpoint = secret {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.kv_path = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.kv_version = 2 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.namespace = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.root_token_id = **** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.ssl_ca_crt_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.timeout = 60.0 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.token_file = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.token_role = None {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.use_ssl = False {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:04 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] ******************************************************************************** {{(pid=87506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:16:04 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:04 devstack cinder-volume[87720]: INFO cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a succeeded Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=87720) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:04 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:04 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:04 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:05 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.289s {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.volume.driver [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.volume.driver [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87720) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_db.sqlalchemy.engines [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG dbcounter [-] [87720] Writer thread running {{(pid=87720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.db.api [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Building query based on filter {{(pid=87720) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.image.image_utils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87720) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.keymgr.migration [None req-264f5bef-4fab-4f84-84c2-27dde130590f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=87720) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=87720) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:05 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:05 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:05 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.342s {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Notifying Schedulers of capabilities ... {{(pid=87720) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.volume.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Driver initialization completed successfully. Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Initiating service 3 cleanup Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Service 3 cleanup completed. Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.service [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Creating RPC server for service cinder-volume {{(pid=87720) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.service [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87720) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:05 devstack cinder-volume[87720]: INFO cinder.volume.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=87720) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG cinder.volume.drivers.quobyte [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=87720) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87720) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:05 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:05 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:05 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:06 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:06 devstack cinder-volume[87720]: DEBUG oslo_concurrency.processutils [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.281s {{(pid=87720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:06 devstack cinder-volume[87720]: INFO cinder.volume.manager [None req-2f39747d-f98f-4e7d-a68f-7627c5681041 None None] Driver post RPC initialization completed successfully. Jul 23 03:16:08 devstack cinder-volume[87506]: INFO oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Caught SIGTERM, stopping children Jul 23 03:16:08 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Acquiring lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:08 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Acquired lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:08 devstack cinder-volume[87506]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Releasing lock "singleton_lock" {{(pid=87506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:08 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Stop services. {{(pid=87506) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:16:08 devstack cinder-volume[87506]: DEBUG oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Killing children. {{(pid=87506) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:16:08 devstack cinder-volume[87506]: INFO oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Waiting on 1 children to exit Jul 23 03:16:09 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Acquiring lock "singleton_lock" {{(pid=87720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:09 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Acquired lock "singleton_lock" {{(pid=87720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:09 devstack cinder-volume[87720]: DEBUG oslo_concurrency.lockutils [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Releasing lock "singleton_lock" {{(pid=87720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:09 devstack cinder-volume[87720]: WARNING amqp [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:10 devstack cinder-volume[87720]: WARNING amqp [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:10 devstack cinder-volume[87506]: INFO oslo_service.backend._eventlet.service [None req-466d813c-e1c8-4be7-bf7b-0fa2f60bbe49 None None] Child 87720 exited with status 0 Jul 23 03:16:10 devstack cinder-volume[87991]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:16:10 devstack cinder-volume[87991]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:16:10 devstack cinder-volume[87991]: we strongly recommend against using it for new projects. Jul 23 03:16:10 devstack cinder-volume[87991]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:16:10 devstack cinder-volume[87991]: framework. For more detail see Jul 23 03:16:10 devstack cinder-volume[87991]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:16:10 devstack cinder-volume[87991]: import eventlet # noqa Jul 23 03:16:12 devstack cinder-volume[87991]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:12 devstack cinder-volume[87991]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:12 devstack cinder-volume[87991]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:13 devstack cinder-volume[87991]: INFO dbcounter [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Registered counter for database cinder Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_db.sqlalchemy.engines [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG dbcounter [-] [87991] Writer thread running {{(pid=87991) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:13 devstack cinder-volume[87991]: INFO cinder.rpc [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:16:13 devstack cinder-volume[87991]: INFO cinder.rpc [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_db.sqlalchemy.engines [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:13 devstack cinder-volume[87991]: INFO cinder.volume.manager [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Determined volume DB was empty at startup. Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG cinder.volume.manager [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87991) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:16:13 devstack cinder-volume[87991]: WARNING stevedore.named [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:16:13 devstack cinder-volume[87991]: WARNING castellan.key_manager [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:13 devstack cinder-volume[87991]: WARNING cinder.keymgr.conf_key_mgr [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:13 devstack cinder-volume[87991]: INFO cinder.volume.manager [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_db.sqlalchemy.engines [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:13 devstack cinder-volume[87991]: INFO oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Starting 1 workers Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Started child 88044 {{(pid=87991) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Full set of CONF: {{(pid=87991) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] ******************************************************************************** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] Configuration options gathered from: {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] ================================================================================ {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] allow_availability_zone_fallback = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[88044]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] allow_compression_on_image_upload = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] allowed_direct_url_schemes = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] api_rate_limit = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] auth_strategy = keystone {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_availability_zone = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_host = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_stats_polling_interval = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backup_api_class = cinder.backup.api.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backup_name_template = backup-%s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backup_use_same_host = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backup_use_temp_snapshot = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] chap_password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] chap_username = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_internal_tenant_project_id = 46582662164a41afb8687acc0a4497f3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_internal_tenant_user_id = 5eba050de6f24299a86b0e421c87ce5c {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cluster = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] compression_format = gzip {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] compute_api_class = cinder.compute.nova.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] config_dir = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] config_source = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] control_exchange = openstack {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] debug = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] default_availability_zone = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] default_group_type = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] default_volume_type = QuobyteHD {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] disk_geometry = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_client_cert = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_client_cert_key = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_data_namespace = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_ssl_cert_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_ssl_cert_verify = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] driver_use_ssl = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] enable_new_services = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] enable_unsupported_driver = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] enabled_backends = ['QuobyteHD'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] enforce_multipath_for_image_xfer = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] filter_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_api_insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_api_ssl_compression = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_ca_certificates_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_catalog_info = image:glance:publicURL {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_num_retries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance_request_timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] goodness_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] graceful_shutdown_timeout = 5 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] group_api_class = cinder.group.api.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] host = devstack {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_compress_on_upload = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_conversion_address_space_limit = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_conversion_cpu_limit = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_conversion_disable = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_upload_use_cinder_backend = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_upload_use_internal_tenant = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_volume_cache_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_volume_cache_max_count = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] image_volume_cache_max_size_gb = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] init_host_max_objects_retrieval = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] instance_format = [instance: %(uuid)s] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iscsi_target_flags = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iscsi_write_cache = on {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iser_helper = tgtadm {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iser_ip_address = 192.168.122.205 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iser_port = 3260 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_color = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_config_append = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_dir = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_options = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_rotate_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_rotate_interval_type = days {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] log_rotation_type = none {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] max_age = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] max_logfile_count = 30 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] max_logfile_size_mb = 200 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] max_over_subscription_ratio = 20.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] message_reap_interval = 86400 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] message_ttl = 2592000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] migration_create_volume_timeout_secs = 300 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] monkey_patch = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] monkey_patch_modules = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] my_ip = 192.168.122.205 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] no_snapshot_gb_quota = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] num_iser_scan_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] num_shell_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] num_volume_device_scan_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] nvmeof_conn_info_version = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] nvmet_ns_id = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] nvmet_port_id = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88044) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_max_limit = 1000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_ext_list = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_listen_port = 8776 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_use_ssl = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] osapi_volume_workers = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] per_volume_size_limit = -1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] periodic_fuzzy_delay = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] periodic_interval = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] public_endpoint = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] publish_errors = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_backup_gigabytes = 1000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_backups = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_gigabytes = 1000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_groups = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_snapshots = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] quota_volumes = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] rate_limit_burst = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] rate_limit_except_level = CRITICAL {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] rate_limit_interval = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] reinit_driver_count = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] replication_device = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] report_discard_supported = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] report_interval = 120 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] reservation_clean_interval = 86400 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] reservation_expire = 86400 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] reserved_image_namespaces = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] reserved_percentage = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] rpc_response_timeout = 120 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] run_external_periodic_tasks = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] scst_target_driver = iscsi {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] scst_target_iqn_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_down_time = 720 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] shell_completion = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] snapshot_name_template = snapshot-%s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] split_loggers = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] state_path = /opt/stack/data/cinder {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] storage_availability_zone = nova {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] storage_protocol = iSCSI {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] syslog_log_facility = LOG_USER {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_helper = lioadm {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_ip_address = 192.168.122.205 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_port = 3260 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_protocol = iscsi {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] target_secondary_ip_addresses = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] trace_flags = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] transport_url = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] until_refresh = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_chap_auth = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_default_quota_class = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_journal = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_json = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_multipath_for_image_xfer = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_stderr = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] use_syslog = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] verify_glance_signatures = enabled {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_api_class = cinder.volume.api.API {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_backend_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_clear = zero {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_clear_ionice = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_clear_size = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_copy_bps_limit = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_dd_blocksize = 1M {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_name_template = volume-%s {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_service_inithost_offload = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volume_usage_audit_period = month {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] zoning_mode = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_concurrency.disable_process_locking = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.auth_section = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.auth_type = password {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.auth_version = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.cache = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.include_service_catalog = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.interface = public {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_password = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcache_username = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.region_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.service_type = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.backend = dogpile.cache.null {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.backend_argument = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.backend_expiration_time = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.config_prefix = cache.oslo {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.debug_cache_backend = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.enable_retry_client = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.enable_socket_keepalive = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.expiration_time = 600 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.hashclient_retry_attempts = 2 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_dead_retry = 300 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_pool_maxsize = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_sasl_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.proxies = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.redis_db = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.redis_server = localhost:6379 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.retry_attempts = 2 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.retry_delay = 0.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.socket_keepalive_count = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.socket_keepalive_idle = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.socket_keepalive_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.socket_timeout = 1.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.tls_allowed_ciphers = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.tls_cafile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.tls_certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.tls_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.tls_keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cache.username = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] coordination.backend_url = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.asyncio_connection = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.asyncio_slave_connection = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.backend = sqlalchemy {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.connection = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.connection_debug = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.connection_parameters = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.connection_recycle_time = 3600 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.connection_trace = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.db_inc_retry_interval = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.db_max_retries = 20 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.db_max_retry_interval = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.db_retry_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.max_overflow = 50 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.max_pool_size = 5 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.max_retries = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.mysql_wsrep_sync_wait = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.pool_timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.retry_interval = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.slave_connection = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.sqlite_synchronous = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.synchronous_reader = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] database.use_db_reconnect = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.connection_string = messaging:// {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.es_doc_type = notification {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.es_scroll_size = 10000 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.es_scroll_time = 2m {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.filter_error_trace = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.hmac_keys = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.sentinel_service_name = mymaster {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.socket_timeout = 0.1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.trace_requests = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler.trace_sqlalchemy = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler_jaeger.process_tags = {} {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler_jaeger.service_name_prefix = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] profiler_otlp.service_name_prefix = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88044) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:16:13 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.enforce_new_defaults = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.policy_default_rule = default {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.policy_file = policy.yaml {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.group = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.helper_command = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] privsep_osbrick.user = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.group = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.helper_command = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] cinder_sys_admin.user = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.auth_section = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.auth_type = password {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.cafile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.collect_timing = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.send_service_user_token = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.split_loggers = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] service_user.timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.auth_section = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.auth_type = password {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.collect_timing = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.region_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.split_loggers = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] glance.timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.backend_availability_zone = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.chap_password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.chap_username = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.disk_geometry = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_client_cert = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_client_cert_key = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_data_namespace = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.driver_use_ssl = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.extra_capabilities = {} {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.filter_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.goodness_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iscsi_target_flags = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iscsi_write_cache = on {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iser_helper = tgtadm {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iser_port = 3260 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_host = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_login = admin {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_mount_options = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_private_key = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_share_path = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.num_shell_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.quobyte_volume_url = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.replication_device = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.report_discard_supported = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.reserved_percentage = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_helper = tgtadm {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_port = 3260 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_protocol = iscsi {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.trace_flags = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.unique_fqdn_network = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.use_chap_auth = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_backend_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_clear = zero {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_clear_ionice = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_clear_size = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_reports.file_event_handler = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_reports.log_dir = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.backend_availability_zone = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.backend_host = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.chap_password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.chap_username = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.chiscsi_conf = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.disk_geometry = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_client_cert = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_data_namespace = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.driver_use_ssl = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.extra_capabilities = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.filter_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.goodness_function = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iser_helper = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iser_ip_address = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iser_port = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.iser_target_prefix = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_host = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_login = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_mount_options = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_password = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_private_key = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_share_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_ssh_port = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack quobyte-client[88045]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.num_shell_tries = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack quobyte-client[88045]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.nvmet_port_id = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.replication_device = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.report_discard_supported = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.reserved_percentage = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.scst_target_driver = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.storage_protocol = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_helper = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_ip_address = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_port = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_prefix = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_protocol = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.trace_flags = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.use_chap_auth = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_clear = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_clear_size = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] QuobyteHD.volumes_dir = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_notifications.driver = [] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_notifications.retry = -1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] key_manager.fixed_key = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.barbican_api_version = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.barbican_endpoint = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.barbican_endpoint_type = public {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.barbican_region_name = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.cafile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.collect_timing = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.number_of_retries = 60 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.retry_delay = 1 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.send_service_user_token = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.split_loggers = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.verify_ssl = True {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican.verify_ssl_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.auth_section = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.auth_type = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.cafile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.certfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.collect_timing = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.insecure = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.keyfile = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.split_loggers = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] barbican_service_user.timeout = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.approle_role_id = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.approle_secret_id = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.auth_method = approle {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.auth_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.kv_mountpoint = secret {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.kv_path = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.kv_version = 2 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.namespace = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.root_token_id = **** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.ssl_ca_crt_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.timeout = 60.0 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.token_file = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.token_role = None {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.use_ssl = False {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:13 devstack cinder-volume[87991]: DEBUG oslo_service.backend._eventlet.service [None req-f9718ca0-162c-47d5-8b8a-4b1bde6f8f22 None None] ******************************************************************************** {{(pid=87991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:16:13 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:13 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:14 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.225s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.volume.driver [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.volume.driver [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88044) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_db.sqlalchemy.engines [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writer thread running {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.db.api [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Building query based on filter {{(pid=88044) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88044) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.keymgr.migration [None req-1acacce2-32f9-4870-8eb5-a7c6a44b4c28 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:14 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:14 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:14 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.229s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Driver initialization completed successfully. Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Initiating service 3 cleanup Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Service 3 cleanup completed. Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.service [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Creating RPC server for service cinder-volume {{(pid=88044) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.service [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88044) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:14 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:16:14 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:14 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.234s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cb74c8de-181a-4594-a8b4-90a993c575b3 None None] Driver post RPC initialization completed successfully. Jul 23 03:16:23 devstack cinder-volume[87991]: DEBUG dbcounter [-] [87991] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87991) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:16:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 6 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:16:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:35 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:17:35 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:36 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.237s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:17:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:17:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 6 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:17:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:18:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:35 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:18:35 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:36 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Flow 'volume_create_manager' (8a7ea7e0-c7d9-48df-93bd-ab5b6f033fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43c554d-8146-4403-b021-45855f1c6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43c554d-8146-4403-b021-45855f1c6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1679501390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d6a08e-15b3-458d-89a1-a5846accbb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e69a6bf4c1540a58d1d4e44e422c5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:46Z,use_quota=True,user_id='138161cb95d244169a8a628e9a7fdb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c1f0b7-3d13-4cff-a3a3-607cdb070488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c1f0b7-3d13-4cff-a3a3-607cdb070488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc5167d-54ff-4c7b-9e86-35208d83b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc5167d-54ff-4c7b-9e86-35208d83b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d6a08e-15b3-458d-89a1-a5846accbb0e', 'volume_name': 'volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125c03f0-42e5-4b4b-b420-c6146bcb38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125c03f0-42e5-4b4b-b420-c6146bcb38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053c7e01-ee72-43bb-a39c-6c6c127a1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Volume e7d6a08e-15b3-458d-89a1-a5846accbb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e', 'volume_size': 1} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1679501390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d6a08e-15b3-458d-89a1-a5846accbb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e69a6bf4c1540a58d1d4e44e422c5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:46Z,use_quota=True,user_id='138161cb95d244169a8a628e9a7fdb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Creating volume e7d6a08e-15b3-458d-89a1-a5846accbb0e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:18:45 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:18:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:46 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e 1073741824 Jul 23 03:18:46 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:46 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e 1073741824" returned: 0 in 0.893s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:47 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e Jul 23 03:18:47 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:47 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053c7e01-ee72-43bb-a39c-6c6c127a1c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65179921-e7b5-4cc5-a865-fd29e5c53726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Volume volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e (e7d6a08e-15b3-458d-89a1-a5846accbb0e): created successfully Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65179921-e7b5-4cc5-a865-fd29e5c53726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Flow 'volume_create_manager' (8a7ea7e0-c7d9-48df-93bd-ab5b6f033fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae5d499a-558b-48a9-9048-b00223c83a47 tempest-TaggedAttachmentsTest-1173861246 None] Created volume successfully. Jul 23 03:18:57 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:57 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Flow 'volume_create_manager' (846960c7-9f8a-4543-9b33-9d94a615e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffaa05a-dd86-48cd-9807-1fd4fcfe763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffaa05a-dd86-48cd-9807-1fd4fcfe763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-832806320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343f3400-25b0-486c-a914-80d6346e3eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80003e2511164e8c8f2550886b2653dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:22Z,use_quota=True,user_id='8a79534c495346f49c6b2f0d35e541d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16d626-5b6d-4117-af5d-3011d5189bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16d626-5b6d-4117-af5d-3011d5189bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fdecfe-13de-4499-885a-d1c5654c9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fdecfe-13de-4499-885a-d1c5654c9929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343f3400-25b0-486c-a914-80d6346e3eba', 'volume_name': 'volume-343f3400-25b0-486c-a914-80d6346e3eba', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1086ea2a-0ef2-4ef6-973c-066a6cdacb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1086ea2a-0ef2-4ef6-973c-066a6cdacb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef0f853-71bc-4a3c-803a-97c99c59d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Volume 343f3400-25b0-486c-a914-80d6346e3eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343f3400-25b0-486c-a914-80d6346e3eba', 'volume_size': 1} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-832806320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343f3400-25b0-486c-a914-80d6346e3eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80003e2511164e8c8f2550886b2653dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:22Z,use_quota=True,user_id='8a79534c495346f49c6b2f0d35e541d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Creating volume 343f3400-25b0-486c-a914-80d6346e3eba {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:22 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:19:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:22 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba 1073741824 Jul 23 03:19:22 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:23 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba 1073741824" returned: 0 in 0.986s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:23 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba Jul 23 03:19:23 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:23 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef0f853-71bc-4a3c-803a-97c99c59d119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343f3400-25b0-486c-a914-80d6346e3eba', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b93e9-738a-470f-a23f-129a43443fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Volume volume-343f3400-25b0-486c-a914-80d6346e3eba (343f3400-25b0-486c-a914-80d6346e3eba): created successfully Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b93e9-738a-470f-a23f-129a43443fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Flow 'volume_create_manager' (846960c7-9f8a-4543-9b33-9d94a615e85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b9b173f5-0c44-49fc-968c-843b9e12623e tempest-VolumesAdminNegativeTest-50850033 None] Created volume successfully. Jul 23 03:19:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Acquiring lock "cinder-343f3400-25b0-486c-a914-80d6346e3eba-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "cinder-343f3400-25b0-486c-a914-80d6346e3eba-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Acquiring lock "cinder-quobyte-343f3400-25b0-486c-a914-80d6346e3eba" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "cinder-quobyte-343f3400-25b0-486c-a914-80d6346e3eba" acquired by "delete_volume" :: waited 0.037s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:26 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0a155zf7/privsep.sock'] Jul 23 03:19:26 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0a155zf7/privsep.sock Jul 23 03:19:26 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:19:27 devstack cinder-volume[88044]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 23 03:19:28 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:28 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Spawned new privsep daemon via rootwrap Jul 23 03:19:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Accepted privsep connection to /tmp/tmp0a155zf7/privsep.sock {{(pid=88044) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 23 03:19:28 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 23 03:19:28 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 23 03:19:28 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 23 03:19:28 devstack cinder-volume[88044]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89714 Jul 23 03:19:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed1110-0c47-40c6-a65c-d0a89f6d7bc6]: (2,) {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b93cda2-932e-42f6-bca0-3a5f2cfd50b2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:28 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba Jul 23 03:19:28 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:29 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba" returned: 0 in 0.876s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:29 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba Jul 23 03:19:29 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:29 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-343f3400-25b0-486c-a914-80d6346e3eba" returned: 0 in 0.409s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "cinder-quobyte-343f3400-25b0-486c-a914-80d6346e3eba" released by "delete_volume" :: held 3.208s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:29 devstack cinder-volume[88044]: WARNING cinder.quota [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:19:29 devstack cinder-volume[88044]: WARNING cinder.quota [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Created reservations ['edcb6d8e-a785-437e-8fac-8667bd80309f', 'af46d08a-4b70-48d1-bea5-f6815908fb2f', '3907ba7d-b05d-4a32-99bd-58c00647eb90', '7bf0a5be-3a35-49aa-8717-b14f2cd9a2e9'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:29 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:19:29 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:30 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.641s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:30 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Deleted volume successfully. Jul 23 03:19:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9731a21c-1f75-448f-ba7f-94ff415589b5 tempest-VolumesAdminNegativeTest-50850033 None] Lock "cinder-343f3400-25b0-486c-a914-80d6346e3eba-delete_volume" released by "delete_volume" :: held 4.504s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:35 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:19:35 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:36 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.324s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:19:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Flow 'volume_create_manager' (3dd5abcb-e170-4910-acdc-dab7f7b2fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130b1dd6-8fd3-4337-a35e-0c3630e19e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130b1dd6-8fd3-4337-a35e-0c3630e19e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-694801793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e95701-b6c9-47f7-bd3e-daf4a554a275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5f0ce3bd6546cda60cdf62b8d6ce36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:38Z,use_quota=True,user_id='aa9da60fb57b4aa99f1901e13e654a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4637d79-c3de-4939-a6eb-5b4ef60c2ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4637d79-c3de-4939-a6eb-5b4ef60c2ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f1d15-81ba-4a99-9215-2e4cdadb8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f1d15-81ba-4a99-9215-2e4cdadb8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e95701-b6c9-47f7-bd3e-daf4a554a275', 'volume_name': 'volume-05e95701-b6c9-47f7-bd3e-daf4a554a275', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34491be-6594-4a93-bd7f-519b53d0904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34491be-6594-4a93-bd7f-519b53d0904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a080425-e613-4938-ab41-7fdc117b5123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Volume 05e95701-b6c9-47f7-bd3e-daf4a554a275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e95701-b6c9-47f7-bd3e-daf4a554a275', 'volume_size': 1} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-694801793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e95701-b6c9-47f7-bd3e-daf4a554a275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5f0ce3bd6546cda60cdf62b8d6ce36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:38Z,use_quota=True,user_id='aa9da60fb57b4aa99f1901e13e654a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Creating volume 05e95701-b6c9-47f7-bd3e-daf4a554a275 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:38 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:19:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:38 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 1073741824 Jul 23 03:19:38 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:39 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 1073741824" returned: 0 in 0.528s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:39 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 Jul 23 03:19:39 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:39 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a080425-e613-4938-ab41-7fdc117b5123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e95701-b6c9-47f7-bd3e-daf4a554a275', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71031b-2250-4671-a8c1-497e58933e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Volume volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 (05e95701-b6c9-47f7-bd3e-daf4a554a275): created successfully Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71031b-2250-4671-a8c1-497e58933e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Flow 'volume_create_manager' (3dd5abcb-e170-4910-acdc-dab7f7b2fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e313a459-799c-4d5b-a067-74967f3d6d8c tempest-AttachVolumeShelveTestJSON-157404675 None] Created volume successfully. Jul 23 03:19:49 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:49 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:58 devstack cinder-volume[88044]: WARNING py.warnings [req-1a64f022-b7b8-4ce6-b16e-a1d8390be397 req-12d29ee0-210a-4fe2-ae7c-c967fe2c6b2f tempest-AttachVolumeShelveTestJSON-157404675 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 23 03:19:58 devstack cinder-volume[88044]: .first() Jul 23 03:19:58 devstack cinder-volume[88044]: Jul 23 03:19:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-1a64f022-b7b8-4ce6-b16e-a1d8390be397 req-12d29ee0-210a-4fe2-ae7c-c967fe2c6b2f tempest-AttachVolumeShelveTestJSON-157404675 None] No connector for attachment ad6a2850-6df4-49e7-8a73-e800d803cda8; skipping storage backend terminate_connection call. {{(pid=88044) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 23 03:19:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-1a64f022-b7b8-4ce6-b16e-a1d8390be397 req-12d29ee0-210a-4fe2-ae7c-c967fe2c6b2f tempest-AttachVolumeShelveTestJSON-157404675 None] Deleting attachment ad6a2850-6df4-49e7-8a73-e800d803cda8. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Flow 'volume_create_manager' (b631cd4a-6c07-4e14-af71-7a6d61cb5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370f84cd-a712-4dc4-977e-806ef535f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370f84cd-a712-4dc4-977e-806ef535f384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1263847364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b862ae56-4afe-4955-88d5-35b31ec9e6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4adc2ae721c240e0b69b7b3657ea4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:01Z,use_quota=True,user_id='f027e158cfab4b80b500eabf7652f225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d95bdd2-b7f7-43dd-ba04-3627a1a414d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d95bdd2-b7f7-43dd-ba04-3627a1a414d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d04260-0cea-4775-8f56-b8839767f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d04260-0cea-4775-8f56-b8839767f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b862ae56-4afe-4955-88d5-35b31ec9e6a8', 'volume_name': 'volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92289c73-64b1-4fcf-8978-f0138b5f2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92289c73-64b1-4fcf-8978-f0138b5f2020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d39df8-3c9f-4407-a6eb-1bd818124bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:01 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Volume b862ae56-4afe-4955-88d5-35b31ec9e6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8', 'volume_size': 1} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1263847364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b862ae56-4afe-4955-88d5-35b31ec9e6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4adc2ae721c240e0b69b7b3657ea4b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:01Z,use_quota=True,user_id='f027e158cfab4b80b500eabf7652f225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Creating volume b862ae56-4afe-4955-88d5-35b31ec9e6a8 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:01 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:20:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:01 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 1073741824 Jul 23 03:20:01 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:02 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 1073741824" returned: 0 in 0.916s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:02 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 Jul 23 03:20:02 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:02 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8" returned: 0 in 0.450s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d39df8-3c9f-4407-a6eb-1bd818124bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06598eb3-5955-4ffc-b643-4c27a3255b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Volume volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 (b862ae56-4afe-4955-88d5-35b31ec9e6a8): created successfully Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06598eb3-5955-4ffc-b643-4c27a3255b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Flow 'volume_create_manager' (b631cd4a-6c07-4e14-af71-7a6d61cb5004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-69d0ad40-c46c-4800-98aa-604867993fa0 tempest-DeleteServersTestJSON-919060691 None] Created volume successfully. Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e366986e-ab0f-4e4f-9aa8-07a48bb71274 req-7b33cb72-f4fc-4105-b3c7-acbd922e9a5c tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e366986e-ab0f-4e4f-9aa8-07a48bb71274 req-7b33cb72-f4fc-4105-b3c7-acbd922e9a5c tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e366986e-ab0f-4e4f-9aa8-07a48bb71274 req-7b33cb72-f4fc-4105-b3c7-acbd922e9a5c tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e366986e-ab0f-4e4f-9aa8-07a48bb71274 req-7b33cb72-f4fc-4105-b3c7-acbd922e9a5c tempest-TaggedAttachmentsTest-1173861246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '914c0459-1571-4d85-a235-303626dd9c8d', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b6b3e528-0910-4bed-ad5f-c336742d664b req-36af4803-a2f8-43bb-89d2-78e25d2550c4 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b6b3e528-0910-4bed-ad5f-c336742d664b req-36af4803-a2f8-43bb-89d2-78e25d2550c4 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b6b3e528-0910-4bed-ad5f-c336742d664b req-36af4803-a2f8-43bb-89d2-78e25d2550c4 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e366986e-ab0f-4e4f-9aa8-07a48bb71274 req-7b33cb72-f4fc-4105-b3c7-acbd922e9a5c tempest-TaggedAttachmentsTest-1173861246 None] attachment_update completed successfully. Jul 23 03:20:06 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b6b3e528-0910-4bed-ad5f-c336742d664b req-36af4803-a2f8-43bb-89d2-78e25d2550c4 tempest-DeleteServersTestJSON-919060691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '528ebfef-b697-451c-8eb5-88c4e4a84a2a', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:20:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-b6b3e528-0910-4bed-ad5f-c336742d664b req-36af4803-a2f8-43bb-89d2-78e25d2550c4 tempest-DeleteServersTestJSON-919060691 None] attachment_update completed successfully. Jul 23 03:20:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e75a2143-861a-4e5c-87ae-6c007a4a8c5a req-c2a85f52-22d5-4304-a13b-d90bf6614768 tempest-TaggedAttachmentsTest-1173861246 None] Terminate volume connection completed successfully. Jul 23 03:20:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e75a2143-861a-4e5c-87ae-6c007a4a8c5a req-c2a85f52-22d5-4304-a13b-d90bf6614768 tempest-TaggedAttachmentsTest-1173861246 None] Deleting attachment 914c0459-1571-4d85-a235-303626dd9c8d. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-8683a773-530c-47a9-8fc9-fa4455417109 req-991309ca-b62d-44d8-98b5-ab86d86fc3d8 tempest-DeleteServersTestJSON-919060691 None] Terminate volume connection completed successfully. Jul 23 03:20:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-8683a773-530c-47a9-8fc9-fa4455417109 req-991309ca-b62d-44d8-98b5-ab86d86fc3d8 tempest-DeleteServersTestJSON-919060691 None] Deleting attachment 528ebfef-b697-451c-8eb5-88c4e4a84a2a. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "cinder-b862ae56-4afe-4955-88d5-35b31ec9e6a8-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "cinder-b862ae56-4afe-4955-88d5-35b31ec9e6a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "cinder-quobyte-b862ae56-4afe-4955-88d5-35b31ec9e6a8" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "cinder-quobyte-b862ae56-4afe-4955-88d5-35b31ec9e6a8" acquired by "delete_volume" :: waited 0.102s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[342dade6-fd58-4c05-b29a-19f04a7395d2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:16 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 Jul 23 03:20:16 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:17 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8" returned: 0 in 0.800s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:17 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8 Jul 23 03:20:17 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:17 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b862ae56-4afe-4955-88d5-35b31ec9e6a8" returned: 0 in 0.420s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "cinder-quobyte-b862ae56-4afe-4955-88d5-35b31ec9e6a8" released by "delete_volume" :: held 1.302s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Created reservations ['1ad4a137-9a1c-4700-8776-dab8f0052a5f', 'e30b92bb-4e51-4903-9358-4e6a63e95087', 'd5beccf7-177c-4eb6-a2f3-5466c355256d', 'e382d537-7a7c-4f17-adf4-62aa2b4cb8ad'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:17 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:20:17 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:18 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.558s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:18 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Deleted volume successfully. Jul 23 03:20:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a0068c1-3269-4091-9c77-068f85dcf164 tempest-DeleteServersTestJSON-919060691 None] Lock "cinder-b862ae56-4afe-4955-88d5-35b31ec9e6a8-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "cinder-e7d6a08e-15b3-458d-89a1-a5846accbb0e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "cinder-e7d6a08e-15b3-458d-89a1-a5846accbb0e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "cinder-quobyte-e7d6a08e-15b3-458d-89a1-a5846accbb0e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "cinder-quobyte-e7d6a08e-15b3-458d-89a1-a5846accbb0e" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56aab69-7880-42f5-95a2-d1985733de9c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:25 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e Jul 23 03:20:25 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:25 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e" returned: 0 in 0.554s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:25 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e Jul 23 03:20:25 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:26 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e7d6a08e-15b3-458d-89a1-a5846accbb0e" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "cinder-quobyte-e7d6a08e-15b3-458d-89a1-a5846accbb0e" released by "delete_volume" :: held 0.899s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Created reservations ['09626d0c-78f7-4947-b987-ab1adc05f6dc', 'a3b027fc-40e5-442c-a95f-326b24d00a50', 'd9f7e99d-3030-4562-8148-55c033eb6299', '8128fd43-4a85-4204-858f-c0120e94cf79'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:26 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:20:26 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:26 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Deleted volume successfully. Jul 23 03:20:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a2ee224-6b43-4657-b302-31d9b1c16ca3 tempest-TaggedAttachmentsTest-1173861246 None] Lock "cinder-e7d6a08e-15b3-458d-89a1-a5846accbb0e-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:35 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:20:35 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:36 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.525s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:20:36 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=33,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Flow 'volume_create_manager' (a62194bd-91f3-496a-8921-32e415acb99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762384e-48f6-4604-a5b8-ffedeef1a33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762384e-48f6-4604-a5b8-ffedeef1a33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1717054381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8d9fd0-880a-4493-b071-48c0a8d6cb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72c9ea83b9f4f09b01438b158cc1f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:49Z,use_quota=True,user_id='60553b5e437940a594304313167d5c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a658bb0-2bfa-44cb-8056-676ba0b11821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a658bb0-2bfa-44cb-8056-676ba0b11821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e070c15-5d90-4672-b4fe-015f7fc76aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e070c15-5d90-4672-b4fe-015f7fc76aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8d9fd0-880a-4493-b071-48c0a8d6cb36', 'volume_name': 'volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ff330a-7e1b-45a6-96bd-c1c16cae7882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ff330a-7e1b-45a6-96bd-c1c16cae7882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6718fc1-270d-45fe-8465-c2f7eaef9e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Volume 4d8d9fd0-880a-4493-b071-48c0a8d6cb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36', 'volume_size': 1} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1717054381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8d9fd0-880a-4493-b071-48c0a8d6cb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72c9ea83b9f4f09b01438b158cc1f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:49Z,use_quota=True,user_id='60553b5e437940a594304313167d5c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Creating volume 4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:49 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:20:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:49 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 1073741824 Jul 23 03:20:49 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:50 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 1073741824" returned: 0 in 0.718s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:50 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 Jul 23 03:20:50 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:50 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" returned: 0 in 0.352s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6718fc1-270d-45fe-8465-c2f7eaef9e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4170b6-5ee0-44ed-b4b2-abb38619e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Volume volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 (4d8d9fd0-880a-4493-b071-48c0a8d6cb36): created successfully Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4170b6-5ee0-44ed-b4b2-abb38619e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Flow 'volume_create_manager' (a62194bd-91f3-496a-8921-32e415acb99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-c2ff15f6-f3df-49af-a181-36c3bf622fee req-f9c5a6ab-36c3-4fac-be85-92ebc7235cc4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Created volume successfully. Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Creating offline snapshot 5f1bcdbe-504b-4c8c-80f6-88224bbd90cc of volume 4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca03735-af79-4518-806b-6e9afc6e040f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:52 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 Jul 23 03:20:52 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:52 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" returned: 0 in 0.565s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:52 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc 1G Jul 23 03:20:52 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:53 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc 1G" returned: 0 in 0.513s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:53 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc Jul 23 03:20:53 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:53 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" returned: 0 in 0.341s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc is being set with open permissions: ugo+rw Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:53 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc Jul 23 03:20:53 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Acquiring lock "cinder-05e95701-b6c9-47f7-bd3e-daf4a554a275-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:53 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" returned: 0 in 0.312s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "cinder-05e95701-b6c9-47f7-bd3e-daf4a554a275-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Acquiring lock "cinder-quobyte-05e95701-b6c9-47f7-bd3e-daf4a554a275" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "cinder-quobyte-05e95701-b6c9-47f7-bd3e-daf4a554a275" acquired by "delete_volume" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:54 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info Jul 23 03:20:54 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef7eec-89d8-4302-b537-b93eea15e748]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:54 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 Jul 23 03:20:54 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:54 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info" returned: 0 in 0.321s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:54 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info is being set with open permissions: ugo+rw Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:54 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info Jul 23 03:20:54 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:54 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275" returned: 0 in 0.622s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:54 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275 Jul 23 03:20:54 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:54 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.info" returned: 0 in 0.627s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-fbb7790c-1f4d-4fa3-bbbe-5e9577a6c011 req-edcb0e82-95a6-44f4-ba2f-600011ccbec0 tempest-VolumesSnapshotsTestJSON-1840566028 None] Create snapshot completed successfully Jul 23 03:20:55 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-05e95701-b6c9-47f7-bd3e-daf4a554a275" returned: 0 in 0.574s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "cinder-quobyte-05e95701-b6c9-47f7-bd3e-daf4a554a275" released by "delete_volume" :: held 1.296s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Created reservations ['e9d4db8b-1718-40f2-a22a-74d551215c2c', 'c7e44217-2733-4741-a3df-52234b9c7404', 'cb4b0ba3-b0fc-4a49-bd46-978bff23a701', 'fb79b1fc-fbb8-44c5-b661-0cf50db7744a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:55 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:20:55 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:55 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.404s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Deleted volume successfully. Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d78c511a-7c6d-4c01-b732-e4d0ea20c0d7 tempest-AttachVolumeShelveTestJSON-157404675 None] Lock "cinder-05e95701-b6c9-47f7-bd3e-daf4a554a275-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "cinder-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "cinder-quobyte-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Deleting offline snapshot 5f1bcdbe-504b-4c8c-80f6-88224bbd90cc of volume 4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] snapshot_file for this snap is: volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e785f-3770-4c9e-b43e-d504f8f98b54]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:56 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc Jul 23 03:20:56 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:57 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" returned: 0 in 0.767s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[068598a0-c722-4fbd-8e98-8a0454e266b2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:57 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 Jul 23 03:20:57 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:57 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" returned: 0 in 0.594s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:57 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc Jul 23 03:20:57 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:58 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" returned: 0 in 0.885s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:58 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc Jul 23 03:20:58 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:59 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36.5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" returned: 0 in 0.354s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc" released by "_delete_snapshot" :: held 2.795s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" released by "delete_snapshot" :: held 2.859s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:59 devstack cinder-volume[88044]: WARNING cinder.quota [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:59 devstack cinder-volume[88044]: DEBUG cinder.quota [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Created reservations ['321e2ec9-37bf-4d63-bf73-1ee1077b7ca8', '9e205042-0f57-4eaa-8973-164bd80ba202', '945d6833-224b-4431-8a25-277ea1609a29', '50f9338c-5dbe-4202-8147-9368408e7ab3'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Delete snapshot completed successfully. Jul 23 03:20:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-b19f616d-ac43-4cc5-b943-625b63d947ab req-d114bd00-be21-4586-a93b-171170feeab4 tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-5f1bcdbe-504b-4c8c-80f6-88224bbd90cc-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "cinder-4d8d9fd0-880a-4493-b071-48c0a8d6cb36-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-4d8d9fd0-880a-4493-b071-48c0a8d6cb36-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd620f2b-36b9-4ccc-8219-8e622e8ba723]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:02 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 Jul 23 03:21:02 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:02 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" returned: 0 in 0.429s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:02 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36 Jul 23 03:21:02 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:03 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-quobyte-4d8d9fd0-880a-4493-b071-48c0a8d6cb36" released by "delete_volume" :: held 0.984s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG cinder.quota [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Created reservations ['204b51e5-1ed7-4ac0-b10b-d8a4af395e8e', '5afd250d-19a0-4b25-84d6-62a1ab49dec8', '408d6b2d-d63a-4ac0-9d7a-9ab75ea42a61', '6c75e630-a110-4607-b6bd-f06e5db084d2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:03 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:03 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:04 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.633s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:04 devstack cinder-volume[88044]: DEBUG cinder.manager [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Deleted volume successfully. Jul 23 03:21:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-c6fba2a6-2ac7-4c3f-b4ce-5229de55dcbe req-3824fcf3-8468-488c-8cbc-64f433251e6b tempest-VolumesSnapshotsTestJSON-1840566028 None] Lock "cinder-4d8d9fd0-880a-4493-b071-48c0a8d6cb36-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Flow 'volume_create_manager' (40037c6e-4a2c-4eb9-bb3d-b9a5d7e81b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a883401-f8a8-4243-8add-308cffb44109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a883401-f8a8-4243-8add-308cffb44109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-710254922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589f9c63-0a42-4d6c-9ac2-48295932cf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c4f0d4beea46a5bfcd219e30aa9823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:09Z,use_quota=True,user_id='b0ffd21df08f49609e7aeb2958c392af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4363f9-4249-468b-8592-99f974775305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4363f9-4249-468b-8592-99f974775305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b7a7e-867e-4569-9b01-ebe9be5c04b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b7a7e-867e-4569-9b01-ebe9be5c04b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589f9c63-0a42-4d6c-9ac2-48295932cf86', 'volume_name': 'volume-589f9c63-0a42-4d6c-9ac2-48295932cf86', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8f1a08-6142-448f-a453-7e65dccf1138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8f1a08-6142-448f-a453-7e65dccf1138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7383c48b-370a-4fe9-b243-8605444fd816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:09 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Volume 589f9c63-0a42-4d6c-9ac2-48295932cf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589f9c63-0a42-4d6c-9ac2-48295932cf86', 'volume_size': 1} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-710254922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589f9c63-0a42-4d6c-9ac2-48295932cf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c4f0d4beea46a5bfcd219e30aa9823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:09Z,use_quota=True,user_id='b0ffd21df08f49609e7aeb2958c392af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Creating volume 589f9c63-0a42-4d6c-9ac2-48295932cf86 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:09 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:09 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 1073741824 Jul 23 03:21:09 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:10 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 1073741824" returned: 0 in 0.866s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:10 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 Jul 23 03:21:10 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:11 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86" returned: 0 in 0.619s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7383c48b-370a-4fe9-b243-8605444fd816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589f9c63-0a42-4d6c-9ac2-48295932cf86', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630f18c2-f031-478c-935e-366e95b78d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Volume volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 (589f9c63-0a42-4d6c-9ac2-48295932cf86): created successfully Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630f18c2-f031-478c-935e-366e95b78d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Flow 'volume_create_manager' (40037c6e-4a2c-4eb9-bb3d-b9a5d7e81b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-33ba41a0-2fe2-4cbb-8b04-f062f2afc61f tempest-ServersNegativeTestJSON-1390050285 None] Created volume successfully. Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (fd54136c-9117-4446-856e-b48fa71f09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adf9397-e32e-4b1f-9843-cfdaa4402f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adf9397-e32e-4b1f-9843-cfdaa4402f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2029627343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35126814-2cc7-4792-a692-4fa45b6eab7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:12Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf639a1-f025-47e6-9ab3-dbab234f7f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf639a1-f025-47e6-9ab3-dbab234f7f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eb053f-7dc5-4bbe-9ffb-46cd7d8014ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eb053f-7dc5-4bbe-9ffb-46cd7d8014ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35126814-2cc7-4792-a692-4fa45b6eab7a', 'volume_name': 'volume-35126814-2cc7-4792-a692-4fa45b6eab7a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd3b5fa-242b-4a3c-b98e-8cc5d0a93a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd3b5fa-242b-4a3c-b98e-8cc5d0a93a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbafdf34-3fe0-40dd-9062-cdb7e1813b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:12 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Volume 35126814-2cc7-4792-a692-4fa45b6eab7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35126814-2cc7-4792-a692-4fa45b6eab7a', 'volume_size': 1} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2029627343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35126814-2cc7-4792-a692-4fa45b6eab7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:12Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Creating volume 35126814-2cc7-4792-a692-4fa45b6eab7a {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:12 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:12 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a 1073741824 Jul 23 03:21:12 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:13 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a 1073741824" returned: 0 in 0.735s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:13 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a Jul 23 03:21:13 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:13 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a" returned: 0 in 0.362s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbafdf34-3fe0-40dd-9062-cdb7e1813b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35126814-2cc7-4792-a692-4fa45b6eab7a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01533096-a065-4574-b78f-fd4054ddd4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Volume volume-35126814-2cc7-4792-a692-4fa45b6eab7a (35126814-2cc7-4792-a692-4fa45b6eab7a): created successfully Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01533096-a065-4574-b78f-fd4054ddd4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (fd54136c-9117-4446-856e-b48fa71f09e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-363457eb-99f0-4e52-89cd-dcc2bbfa55cb tempest-VolumesTestJSON-1240780784 None] Created volume successfully. Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Flow 'volume_create_manager' (05c8833c-ae11-481b-9fdf-130a5d9f9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153147c8-53b0-44f3-902a-93bec903a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153147c8-53b0-44f3-902a-93bec903a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136502608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7253d4b1-3fe6-4aca-bf32-503c30292f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c4f0d4beea46a5bfcd219e30aa9823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:15Z,use_quota=True,user_id='b0ffd21df08f49609e7aeb2958c392af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1873f0-a22f-4773-aae4-1a142543d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1873f0-a22f-4773-aae4-1a142543d115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e7a38-7d03-4efe-aaa6-d303f4ec047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e7a38-7d03-4efe-aaa6-d303f4ec047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7253d4b1-3fe6-4aca-bf32-503c30292f7c', 'volume_name': 'volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d4fde1-00c9-4856-9e01-53279c7271ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d4fde1-00c9-4856-9e01-53279c7271ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc11afb-ae52-4861-b8c2-aee0e8039ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Volume 7253d4b1-3fe6-4aca-bf32-503c30292f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c', 'volume_size': 1} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136502608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7253d4b1-3fe6-4aca-bf32-503c30292f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c4f0d4beea46a5bfcd219e30aa9823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:15Z,use_quota=True,user_id='b0ffd21df08f49609e7aeb2958c392af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Creating volume 7253d4b1-3fe6-4aca-bf32-503c30292f7c {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:14 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:14 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c 1073741824 Jul 23 03:21:14 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (50722f7c-62a9-4fff-a58b-adcb6c4207b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74371316-650d-4f4b-8c8f-8bbb2e0103d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74371316-650d-4f4b-8c8f-8bbb2e0103d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454103006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30ff0c-add7-440d-9573-7d5a3e11a43e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:15Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb47b1b-dc1f-4f1d-8e20-3fd656754097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb47b1b-dc1f-4f1d-8e20-3fd656754097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f6350b-092d-46f7-b9b9-5939fae7d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f6350b-092d-46f7-b9b9-5939fae7d6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd30ff0c-add7-440d-9573-7d5a3e11a43e', 'volume_name': 'volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b888e6a0-8475-45bf-a7f6-83f3fb56a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b888e6a0-8475-45bf-a7f6-83f3fb56a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e237c6-d326-4bed-bb79-aac8a4be3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Volume dd30ff0c-add7-440d-9573-7d5a3e11a43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e', 'volume_size': 1} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:15 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c 1073741824" returned: 0 in 0.754s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:15 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c Jul 23 03:21:15 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:15 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c" returned: 0 in 0.258s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454103006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30ff0c-add7-440d-9573-7d5a3e11a43e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:15Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Creating volume dd30ff0c-add7-440d-9573-7d5a3e11a43e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:15 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc11afb-ae52-4861-b8c2-aee0e8039ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42752d3-c4e3-4edf-a874-72c9350841ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:15 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e 1073741824 Jul 23 03:21:15 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Volume volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c (7253d4b1-3fe6-4aca-bf32-503c30292f7c): created successfully Jul 23 03:21:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42752d3-c4e3-4edf-a874-72c9350841ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Flow 'volume_create_manager' (05c8833c-ae11-481b-9fdf-130a5d9f9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f28bd63e-dc76-49c7-b985-82b16fd57285 tempest-ServersNegativeTestJSON-1390050285 None] Created volume successfully. Jul 23 03:21:16 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e 1073741824" returned: 0 in 0.598s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:16 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e Jul 23 03:21:16 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:17 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e" returned: 0 in 0.369s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e237c6-d326-4bed-bb79-aac8a4be3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833097f9-97c0-4e45-9923-dc35cd68f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Volume volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e (dd30ff0c-add7-440d-9573-7d5a3e11a43e): created successfully Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833097f9-97c0-4e45-9923-dc35cd68f11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (50722f7c-62a9-4fff-a58b-adcb6c4207b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-187c9828-8968-40d7-8ad7-83ed8dbe6f1d tempest-VolumesTestJSON-1240780784 None] Created volume successfully. Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "cinder-7253d4b1-3fe6-4aca-bf32-503c30292f7c-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-7253d4b1-3fe6-4aca-bf32-503c30292f7c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "cinder-quobyte-7253d4b1-3fe6-4aca-bf32-503c30292f7c" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-quobyte-7253d4b1-3fe6-4aca-bf32-503c30292f7c" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b56ba-af5d-4a6f-afad-8a3e17b28f34]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:17 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c Jul 23 03:21:17 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:18 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c" returned: 0 in 0.648s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:18 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c Jul 23 03:21:18 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (7f1ed546-5e67-4a35-b720-783a3c5a28df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bae10e-41fd-4da1-8cb8-53aa3e58d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bae10e-41fd-4da1-8cb8-53aa3e58d01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765136803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368581b0-092d-407f-ad46-1e138de19378,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:18Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d4050a-6868-478c-bd4e-4e8363b9af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d4050a-6868-478c-bd4e-4e8363b9af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf81142b-f8a5-46b6-a4aa-c3d84da1358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf81142b-f8a5-46b6-a4aa-c3d84da1358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368581b0-092d-407f-ad46-1e138de19378', 'volume_name': 'volume-368581b0-092d-407f-ad46-1e138de19378', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658662e3-751c-45e9-ba04-83b080453a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658662e3-751c-45e9-ba04-83b080453a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0378ac-d27c-42e1-af80-cd685e1decbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Volume 368581b0-092d-407f-ad46-1e138de19378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368581b0-092d-407f-ad46-1e138de19378', 'volume_size': 1} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765136803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368581b0-092d-407f-ad46-1e138de19378,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34181f5784884485895ec6bfbe119b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:18Z,use_quota=True,user_id='38ba4668ced24fb3b3d851fb8625f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Creating volume 368581b0-092d-407f-ad46-1e138de19378 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:18 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7253d4b1-3fe6-4aca-bf32-503c30292f7c" returned: 0 in 0.592s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-quobyte-7253d4b1-3fe6-4aca-bf32-503c30292f7c" released by "delete_volume" :: held 1.316s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:18 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 1073741824 Jul 23 03:21:18 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Created reservations ['bedca8a4-895c-483d-aab0-45ffe5c90366', 'eff22c27-f425-4625-8534-bc38d3754a8e', '50d516d6-518e-4a2f-a769-de50ede7e35e', '482cbda9-6291-4150-b2d8-8091221ed436'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:18 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:18 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 1073741824" returned: 0 in 0.758s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.569s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Deleted volume successfully. Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0084a970-05ec-4795-8814-d5fab1e518b9 tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-7253d4b1-3fe6-4aca-bf32-503c30292f7c-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:19 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 Jul 23 03:21:19 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "cinder-589f9c63-0a42-4d6c-9ac2-48295932cf86-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-589f9c63-0a42-4d6c-9ac2-48295932cf86-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "cinder-quobyte-589f9c63-0a42-4d6c-9ac2-48295932cf86" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-quobyte-589f9c63-0a42-4d6c-9ac2-48295932cf86" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069158c-ce7f-4efa-bff0-853683845f51]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:20 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378" returned: 0 in 0.605s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0378ac-d27c-42e1-af80-cd685e1decbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368581b0-092d-407f-ad46-1e138de19378', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf62a81-35ec-49cd-9ac6-fa1d0f3f8afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:20 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Volume volume-368581b0-092d-407f-ad46-1e138de19378 (368581b0-092d-407f-ad46-1e138de19378): created successfully Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf62a81-35ec-49cd-9ac6-fa1d0f3f8afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Flow 'volume_create_manager' (7f1ed546-5e67-4a35-b720-783a3c5a28df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b1be08ff-8b06-4f85-8655-8e33bccdf928 tempest-VolumesTestJSON-1240780784 None] Created volume successfully. Jul 23 03:21:20 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 Jul 23 03:21:20 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:20 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86" returned: 0 in 0.726s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:20 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86 Jul 23 03:21:20 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:21 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-589f9c63-0a42-4d6c-9ac2-48295932cf86" returned: 0 in 0.312s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-quobyte-589f9c63-0a42-4d6c-9ac2-48295932cf86" released by "delete_volume" :: held 1.148s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Created reservations ['3be306f8-3c36-4b0e-a2f5-353d3cea443c', 'f3bff956-2508-4032-b097-597c152ea296', 'a693659e-61d2-4041-8a50-bed50c4c5415', 'b58f37b3-a0d6-4c26-a8a3-9614c43992ad'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:21 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:21 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:21 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Deleted volume successfully. Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9afff1c0-fdc3-4531-a6e2-dd35805e85ed tempest-ServersNegativeTestJSON-1390050285 None] Lock "cinder-589f9c63-0a42-4d6c-9ac2-48295932cf86-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-368581b0-092d-407f-ad46-1e138de19378-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-368581b0-092d-407f-ad46-1e138de19378-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-quobyte-368581b0-092d-407f-ad46-1e138de19378" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-368581b0-092d-407f-ad46-1e138de19378" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ec45b7-4563-4e21-a23a-463b540216c8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:21 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 Jul 23 03:21:21 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:22 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378" returned: 0 in 0.582s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:22 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378 Jul 23 03:21:22 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:22 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-368581b0-092d-407f-ad46-1e138de19378" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-368581b0-092d-407f-ad46-1e138de19378" released by "delete_volume" :: held 1.019s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Created reservations ['dd495c0e-26e2-4b6f-8d89-c41ab0143831', '48c7f673-d156-427c-b812-76142adfdf04', '04abc664-096f-47d5-8831-dd9ad1e1bbb1', '82290d27-10be-4c1d-a399-fb1fd00f3513'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:23 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:23 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:23 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.537s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:23 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Deleted volume successfully. Jul 23 03:21:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1d9d4135-0188-4381-9655-1ca9d3b731b2 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-368581b0-092d-407f-ad46-1e138de19378-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-dd30ff0c-add7-440d-9573-7d5a3e11a43e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "cinder-dd30ff0c-add7-440d-9573-7d5a3e11a43e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-quobyte-dd30ff0c-add7-440d-9573-7d5a3e11a43e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-dd30ff0c-add7-440d-9573-7d5a3e11a43e" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[79082f9d-773f-4c7b-a83e-963084847ec5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:24 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e Jul 23 03:21:24 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:24 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e" returned: 0 in 0.507s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:24 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e Jul 23 03:21:24 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:25 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-dd30ff0c-add7-440d-9573-7d5a3e11a43e" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-dd30ff0c-add7-440d-9573-7d5a3e11a43e" released by "delete_volume" :: held 0.921s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Created reservations ['3e122bb0-8bb1-4a8c-b3d6-45f2ce1a2ff5', 'b1ed02ec-8479-4124-b54b-ead97181a42a', 'f90ff90f-3cbe-4aff-a2be-c578858be7de', 'a3b967d9-2fad-4dfd-b134-d1d9fa74b522'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:25 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:25 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-35126814-2cc7-4792-a692-4fa45b6eab7a-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-35126814-2cc7-4792-a692-4fa45b6eab7a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "cinder-quobyte-35126814-2cc7-4792-a692-4fa45b6eab7a" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-35126814-2cc7-4792-a692-4fa45b6eab7a" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b64648-0b31-432f-a7b2-4cc4623bf2a2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:25 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.292s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Deleted volume successfully. Jul 23 03:21:25 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a Jul 23 03:21:25 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8b8d29c-f594-40f0-84e0-19c956a3b7fb tempest-VolumesTestJSON-1240780784 None] Lock "cinder-dd30ff0c-add7-440d-9573-7d5a3e11a43e-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:25 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a" returned: 0 in 0.443s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:25 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a Jul 23 03:21:25 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:26 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35126814-2cc7-4792-a692-4fa45b6eab7a" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-quobyte-35126814-2cc7-4792-a692-4fa45b6eab7a" released by "delete_volume" :: held 0.793s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Created reservations ['aa94ccf6-aada-40e7-9ad4-b1f85e546baa', '8a76443a-2548-448c-a9e1-8da2524e4635', 'bdd6c2e2-9b9c-4a12-9de5-68a3df978b97', 'ca4b7bc7-d014-4c36-af44-3bc126c1d275'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:26 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:26 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:26 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Deleted volume successfully. Jul 23 03:21:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-531a8281-324c-4f43-8168-1b48bbff94b6 tempest-VolumesTestJSON-1240780784 None] Lock "cinder-35126814-2cc7-4792-a692-4fa45b6eab7a-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Flow 'volume_create_manager' (e74541b4-9c7a-4186-af93-15aa8efaf4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9af026-d5fd-4f6a-9092-1916b6cb6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9af026-d5fd-4f6a-9092-1916b6cb6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1991345914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aebb1d-48a5-4d3d-97da-6ec4e709f88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831f0b491cd044a09ba72644423dd2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:33Z,use_quota=True,user_id='e587702009b24f109a7c6ad8cfbec427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c38251f-5857-4975-ac80-6818dbbcbb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c38251f-5857-4975-ac80-6818dbbcbb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3df5b1-0d52-4248-822b-4a45fb877060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3df5b1-0d52-4248-822b-4a45fb877060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'volume_name': 'volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24ae00-8425-4e8d-a63d-5f57709cebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24ae00-8425-4e8d-a63d-5f57709cebf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15a8a30-e322-4d61-a26a-bd14a9a0be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Volume 21aebb1d-48a5-4d3d-97da-6ec4e709f88b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'volume_size': 1} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1991345914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aebb1d-48a5-4d3d-97da-6ec4e709f88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831f0b491cd044a09ba72644423dd2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:33Z,use_quota=True,user_id='e587702009b24f109a7c6ad8cfbec427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Creating volume 21aebb1d-48a5-4d3d-97da-6ec4e709f88b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:32 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:32 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b 1073741824 Jul 23 03:21:32 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-361c15d2-65a8-418c-a71b-9947af2907d5 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-637148280: creating Jul 23 03:21:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-361c15d2-65a8-418c-a71b-9947af2907d5 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-637148280: created successfully Jul 23 03:21:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-361c15d2-65a8-418c-a71b-9947af2907d5 tempest-GroupSnapshotsTest-2053043439 None] Create group completed successfully. Jul 23 03:21:33 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b 1073741824" returned: 0 in 0.812s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:33 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b Jul 23 03:21:33 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:34 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" returned: 0 in 0.421s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15a8a30-e322-4d61-a26a-bd14a9a0be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042ccbd6-3453-43e2-a0e8-353a93c0e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Volume volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b (21aebb1d-48a5-4d3d-97da-6ec4e709f88b): created successfully Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042ccbd6-3453-43e2-a0e8-353a93c0e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Flow 'volume_create_manager' (e74541b4-9c7a-4186-af93-15aa8efaf4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6df0de5b-8645-4384-8317-f3d03ac4b0bb tempest-ServerActionsTestOtherA-58101324 None] Created volume successfully. Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:35 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:35 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (f9ff77a4-9965-43b1-8416-8db00e6f230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b51b50-2d40-4bf6-ae3f-97b858974246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b51b50-2d40-4bf6-ae3f-97b858974246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211358949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b23f634-40ee-4283-aefb-1a8521f37283,host='devstack@QuobyteHD#QuobyteHD',id=b6de1103-28f5-447a-8f85-2e02dc624022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:36Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eb8907c-9884-422e-b4d7-a3ba7d6d8a37),volume_type_id=8eb8907c-9884-422e-b4d7-a3ba7d6d8a37)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1718da2-c25c-421d-b196-4d9ed7cbc821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1718da2-c25c-421d-b196-4d9ed7cbc821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288baf66-f4c5-42cd-9325-2a459b76446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288baf66-f4c5-42cd-9325-2a459b76446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6de1103-28f5-447a-8f85-2e02dc624022', 'volume_name': 'volume-b6de1103-28f5-447a-8f85-2e02dc624022', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315fc6ba-02a5-41b0-b5e2-2f959047e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315fc6ba-02a5-41b0-b5e2-2f959047e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a878e4a-c5ad-4f7e-a764-9055bf2eeceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Volume b6de1103-28f5-447a-8f85-2e02dc624022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6de1103-28f5-447a-8f85-2e02dc624022', 'volume_size': 1} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b23f634-40ee-4283-aefb-1a8521f37283,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211358949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b23f634-40ee-4283-aefb-1a8521f37283,host='devstack@QuobyteHD#QuobyteHD',id=b6de1103-28f5-447a-8f85-2e02dc624022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:36Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eb8907c-9884-422e-b4d7-a3ba7d6d8a37),volume_type_id=8eb8907c-9884-422e-b4d7-a3ba7d6d8a37)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Creating volume b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:36 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:36 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 1073741824 Jul 23 03:21:36 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:36 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.389s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:21:36 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 1073741824" returned: 0 in 0.708s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:36 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:21:36 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:37 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.375s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a878e4a-c5ad-4f7e-a764-9055bf2eeceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6de1103-28f5-447a-8f85-2e02dc624022', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce6f528-284c-444a-b8a0-c6ad3f2fbf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Volume volume-b6de1103-28f5-447a-8f85-2e02dc624022 (b6de1103-28f5-447a-8f85-2e02dc624022): created successfully Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce6f528-284c-444a-b8a0-c6ad3f2fbf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (f9ff77a4-9965-43b1-8416-8db00e6f230f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-59529060-69eb-41ec-9194-b5c99f791164 tempest-GroupSnapshotsTest-2053043439 None] Created volume successfully. Jul 23 03:21:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] GroupSnapshot 5653149b-8635-47f5-a53e-f99a96359590: creating. Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Group snapshot 5653149b-8635-47f5-a53e-f99a96359590: creating. {{(pid=88044) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Creating offline snapshot 7331b7c2-d836-4b5f-aafb-7ebb0a4ceade of volume b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8325bb9-ddbb-4d15-8285-fae654c93c74]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:39 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:21:39 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:40 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.896s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:40 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade 1G Jul 23 03:21:40 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:41 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade 1G" returned: 0 in 0.889s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6de1103-28f5-447a-8f85-2e02dc624022 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:41 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6de1103-28f5-447a-8f85-2e02dc624022 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:21:41 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:41 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6de1103-28f5-447a-8f85-2e02dc624022 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.493s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:41 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:41 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:21:41 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:42 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:42 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info Jul 23 03:21:42 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:42 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info" returned: 0 in 0.368s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:42 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:42 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info Jul 23 03:21:42 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:43 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.info" returned: 0 in 0.416s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-01a4ffaa-99e2-4adc-93ef-ea0aa761d160 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 5653149b-8635-47f5-a53e-f99a96359590: created successfully Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade-d20b2891-5ccd-4587-8dc5-5e52c180790b" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade-d20b2891-5ccd-4587-8dc5-5e52c180790b" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Creating volume d20b2891-5ccd-4587-8dc5-5e52c180790b from snapshot 7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] snapshot: 7331b7c2-d836-4b5f-aafb-7ebb0a4ceade, volume: d20b2891-5ccd-4587-8dc5-5e52c180790b, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852d7d8-ea18-4e47-ab4e-622cee00e0ee]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:45 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:21:45 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:45 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.603s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6de1103-28f5-447a-8f85-2e02dc624022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd7307-aff2-4f24-a4fe-f92c0fe3a835]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:45 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:21:45 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:46 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.503s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:46 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:21:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:46 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b Jul 23 03:21:46 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:53 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b" returned: 0 in 7.762s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b26c8-9698-4dde-8d98-be3b5ffefbc3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:54 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:21:54 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:54 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=72,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=15 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:21:54 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.910s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:54 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:21:54 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Converted 1024.00 MB image at 131.89 MB/s Jul 23 03:21:54 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:54 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b Jul 23 03:21:54 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:54 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=68,cinder:INSERT=27,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:21:55 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b" returned: 0 in 0.540s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" released by "_copy_volume_from_snapshot" :: held 10.528s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade-d20b2891-5ccd-4587-8dc5-5e52c180790b" released by "_create_volume_from_snapshot" :: held 10.623s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.681s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-94fb218a-5a84-4277-b168-57cbcf7f1c8b tempest-GroupSnapshotsTest-2053043439 None] Create group from source-snapshot-5653149b-8635-47f5-a53e-f99a96359590 completed successfully. Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f0ccb-0ddb-44fc-90e6-39e66d39c66a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b Jul 23 03:21:57 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:57 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b" returned: 0 in 0.488s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b Jul 23 03:21:57 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:58 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d20b2891-5ccd-4587-8dc5-5e52c180790b" returned: 0 in 0.502s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-d20b2891-5ccd-4587-8dc5-5e52c180790b" released by "delete_volume" :: held 1.056s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['3c09c00e-43fd-41f9-aaa0-2fd9a970ba86'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:58 devstack cinder-volume[88044]: WARNING cinder.quota [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-77816608 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-77816608, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:58 devstack cinder-volume[88044]: WARNING cinder.quota [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-77816608 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-77816608, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['3b6f72ca-25a1-443b-b888-83df05026f10', '7c722bf4-fdd4-49dc-b890-9cdf96b60da4', 'bd0ce038-304e-47ba-ac89-7c68407156c6', 'd76455f4-91ed-453d-a00f-a9b23185435c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:59 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:21:59 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:59 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.533s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:59 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-67c77078-d644-4fd9-be28-113d5c9cd093 tempest-GroupSnapshotsTest-2053043439 None] Delete group completed successfully. Jul 23 03:22:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 5653149b-8635-47f5-a53e-f99a96359590: deleting Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 5653149b-8635-47f5-a53e-f99a96359590: deleting {{(pid=88044) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Deleting offline snapshot 7331b7c2-d836-4b5f-aafb-7ebb0a4ceade of volume b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] snapshot_file for this snap is: volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d4296-6ed2-4820-ba83-8c53d22ab16d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:00 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:22:00 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:01 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.654s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6de1103-28f5-447a-8f85-2e02dc624022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f159a759-4d73-4ab0-b50b-ae64bb02d651]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:01 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:22:01 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:01 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.540s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:01 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:22:01 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:02 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.509s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:02 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade Jul 23 03:22:02 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (6825d789-c939-4798-815a-1177d99ea6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e09a35f-6d1a-49e8-b4d0-5c21b9dec9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e09a35f-6d1a-49e8-b4d0-5c21b9dec9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-615159090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940516c9-13e3-4202-9e08-8e753bb053d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46b50be-52f7-4ae0-8e6a-0ec2ba76e37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46b50be-52f7-4ae0-8e6a-0ec2ba76e37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f272bc-d120-4623-8b39-8aca56e7ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f272bc-d120-4623-8b39-8aca56e7ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940516c9-13e3-4202-9e08-8e753bb053d0', 'volume_name': 'volume-940516c9-13e3-4202-9e08-8e753bb053d0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974fbf32-0475-436d-b128-f02e2c347186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974fbf32-0475-436d-b128-f02e2c347186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f06a56-74f3-408e-9843-a3e73f7e1e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Volume 940516c9-13e3-4202-9e08-8e753bb053d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940516c9-13e3-4202-9e08-8e753bb053d0', 'volume_size': 1} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-615159090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940516c9-13e3-4202-9e08-8e753bb053d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Creating volume 940516c9-13e3-4202-9e08-8e753bb053d0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:02 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:02 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 1073741824 Jul 23 03:22:02 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:02 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022.7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" returned: 0 in 0.348s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-7331b7c2-d836-4b5f-aafb-7ebb0a4ceade" released by "_delete_snapshot" :: held 2.201s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" released by "delete_snapshot" :: held 2.239s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:02 devstack cinder-volume[88044]: WARNING cinder.quota [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-77816608 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-77816608, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['24c69f6e-5942-4814-bc33-1d104618079c', '68b13d6f-d448-42a9-b5c3-ff7415af2e6e', 'aa14fb29-b99b-4525-8f84-128c8673c721', '1a797262-5e3c-4d58-a7a1-a160dfa769c1'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c8e62034-5fce-4cf1-93e7-c5210d1508da tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 5653149b-8635-47f5-a53e-f99a96359590: deleted successfully Jul 23 03:22:02 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 1073741824" returned: 0 in 0.645s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:03 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 Jul 23 03:22:03 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:03 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f06a56-74f3-408e-9843-a3e73f7e1e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940516c9-13e3-4202-9e08-8e753bb053d0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c921991-aca9-4f03-b949-06d27b383035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:03 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Volume volume-940516c9-13e3-4202-9e08-8e753bb053d0 (940516c9-13e3-4202-9e08-8e753bb053d0): created successfully Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c921991-aca9-4f03-b949-06d27b383035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (6825d789-c939-4798-815a-1177d99ea6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-adcbd6ac-bab2-4b08-bd5b-3a63a8a06690 tempest-AttachVolumeNegativeTest-515070177 None] Created volume successfully. Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e2536-84b6-4312-85c9-ed49eeb879ce]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:04 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:22:04 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:04 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.664s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:04 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022 Jul 23 03:22:04 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:05 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b6de1103-28f5-447a-8f85-2e02dc624022" returned: 0 in 0.528s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-b6de1103-28f5-447a-8f85-2e02dc624022" released by "delete_volume" :: held 1.338s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['853c932a-0e29-46d7-b2fb-d2b037ccb66a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:05 devstack cinder-volume[88044]: WARNING cinder.db.api [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-77816608'] Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['c446778f-4625-4e09-b21f-6e14f0bfd243', '90205fce-70ec-437b-81ee-67d28d8e97bf', '871c7b7f-64ab-4ca4-a511-edc9700b1c87', 'daa1a630-eb31-48a8-8591-56744011c7f0'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:05 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:22:05 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-6d9fd2bb-7022-47ff-9205-7e97ac0e6c9d req-f3ac1110-2aa5-4a8d-891b-ce516ef5e383 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-6d9fd2bb-7022-47ff-9205-7e97ac0e6c9d req-f3ac1110-2aa5-4a8d-891b-ce516ef5e383 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-6d9fd2bb-7022-47ff-9205-7e97ac0e6c9d req-f3ac1110-2aa5-4a8d-891b-ce516ef5e383 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-6d9fd2bb-7022-47ff-9205-7e97ac0e6c9d req-f3ac1110-2aa5-4a8d-891b-ce516ef5e383 tempest-AttachVolumeNegativeTest-515070177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-940516c9-13e3-4202-9e08-8e753bb053d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7ff8f60-85f4-4bf3-a5da-46c8825bcd17', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-6d9fd2bb-7022-47ff-9205-7e97ac0e6c9d req-f3ac1110-2aa5-4a8d-891b-ce516ef5e383 tempest-AttachVolumeNegativeTest-515070177 None] attachment_update completed successfully. Jul 23 03:22:06 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.517s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:06 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-10131d26-af8c-4e18-b621-87ca8e8fa0c1 tempest-GroupSnapshotsTest-2053043439 None] Delete group completed successfully. Jul 23 03:22:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c7620faa-5879-463e-b89d-f2429cb2ff73 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-1216319170: creating Jul 23 03:22:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c7620faa-5879-463e-b89d-f2429cb2ff73 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-1216319170: created successfully Jul 23 03:22:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c7620faa-5879-463e-b89d-f2429cb2ff73 tempest-GroupSnapshotsTest-2053043439 None] Create group completed successfully. Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (1b4dc4b5-d94b-434e-8d3b-39b2d20a0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881aba55-c0e0-4683-8799-d09e14bbb67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881aba55-c0e0-4683-8799-d09e14bbb67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035911761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,host='devstack@QuobyteHD#QuobyteHD',id=50ba13e7-af3c-4554-8b7c-b36068bebae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:10Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8926b87-bb54-47e3-9562-b45295f09b97),volume_type_id=c8926b87-bb54-47e3-9562-b45295f09b97)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6247c8d-cb7e-4eab-9a2e-4a3fe9a2065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6247c8d-cb7e-4eab-9a2e-4a3fe9a2065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141b70a4-2664-49f5-b61c-ee676d57e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141b70a4-2664-49f5-b61c-ee676d57e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ba13e7-af3c-4554-8b7c-b36068bebae0', 'volume_name': 'volume-50ba13e7-af3c-4554-8b7c-b36068bebae0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cbb421-49da-47aa-a2b4-e64d6402216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cbb421-49da-47aa-a2b4-e64d6402216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76d03cf-4f49-4885-a0ab-1224d60b7c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Volume 50ba13e7-af3c-4554-8b7c-b36068bebae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ba13e7-af3c-4554-8b7c-b36068bebae0', 'volume_size': 1} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,created_at=2026-07-23T01:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035911761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,host='devstack@QuobyteHD#QuobyteHD',id=50ba13e7-af3c-4554-8b7c-b36068bebae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:10Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8926b87-bb54-47e3-9562-b45295f09b97),volume_type_id=c8926b87-bb54-47e3-9562-b45295f09b97)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Creating volume 50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:10 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:22:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:10 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 1073741824 Jul 23 03:22:10 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 1073741824" returned: 0 in 0.647s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:11 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 Jul 23 03:22:11 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0" returned: 0 in 0.423s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76d03cf-4f49-4885-a0ab-1224d60b7c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ba13e7-af3c-4554-8b7c-b36068bebae0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cbe007-4585-47ab-8c30-3556dc0fd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Volume volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 (50ba13e7-af3c-4554-8b7c-b36068bebae0): created successfully Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cbe007-4585-47ab-8c30-3556dc0fd516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (1b4dc4b5-d94b-434e-8d3b-39b2d20a0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-16f0a797-3070-4ad6-9409-98e303084375 tempest-GroupSnapshotsTest-2053043439 None] Created volume successfully. Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (34c79172-2aae-4e1e-af7b-391c431732f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e1bb11-6c48-4cee-a8a7-925db3f650d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e1bb11-6c48-4cee-a8a7-925db3f650d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1562455304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,host='devstack@QuobyteHD#QuobyteHD',id=e82cd064-e180-4381-abe7-93099fd8275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:14Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8926b87-bb54-47e3-9562-b45295f09b97),volume_type_id=c8926b87-bb54-47e3-9562-b45295f09b97)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96963cf0-38b1-4ae1-824c-db11098e8a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96963cf0-38b1-4ae1-824c-db11098e8a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652dbcdb-1cc5-41b0-a63f-135fe99f6b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652dbcdb-1cc5-41b0-a63f-135fe99f6b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82cd064-e180-4381-abe7-93099fd8275b', 'volume_name': 'volume-e82cd064-e180-4381-abe7-93099fd8275b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66e75c-4970-44d8-8d01-05064b0e0d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66e75c-4970-44d8-8d01-05064b0e0d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cedd3-fcd9-421d-917a-ebc14025cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Volume e82cd064-e180-4381-abe7-93099fd8275b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82cd064-e180-4381-abe7-93099fd8275b', 'volume_size': 1} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,created_at=2026-07-23T01:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1562455304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90720a6a-f4cf-4d48-82d1-0f9a466ae975,host='devstack@QuobyteHD#QuobyteHD',id=e82cd064-e180-4381-abe7-93099fd8275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:14Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8926b87-bb54-47e3-9562-b45295f09b97),volume_type_id=c8926b87-bb54-47e3-9562-b45295f09b97)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Creating volume e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:14 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:22:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:14 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b 1073741824 Jul 23 03:22:14 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:15 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b 1073741824" returned: 0 in 1.038s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:15 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b Jul 23 03:22:15 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:15 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cedd3-fcd9-421d-917a-ebc14025cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82cd064-e180-4381-abe7-93099fd8275b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8beed-fc77-42a1-b8b0-9c84f3b3d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Volume volume-e82cd064-e180-4381-abe7-93099fd8275b (e82cd064-e180-4381-abe7-93099fd8275b): created successfully Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8beed-fc77-42a1-b8b0-9c84f3b3d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (34c79172-2aae-4e1e-af7b-391c431732f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-27c0bb06-02a0-4a4c-9a23-0d9e56c6a42b tempest-GroupSnapshotsTest-2053043439 None] Created volume successfully. Jul 23 03:22:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7d7d5984-3ef8-4be1-99e3-d0c7c90a22cb tempest-GroupSnapshotsTest-2053043439 None] Update group completed successfully. Jul 23 03:22:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cf9fcd75-38a6-4d9a-94cf-7936f18a0437 tempest-GroupSnapshotsTest-2053043439 None] Update group completed successfully. Jul 23 03:22:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-12da5a1a-8e06-406a-8e67-a430089aaebe tempest-GroupSnapshotsTest-2053043439 None] Update group completed successfully. Jul 23 03:22:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ebd38173-7102-4143-bf33-ab7484a65ba7 tempest-GroupSnapshotsTest-2053043439 None] Update group completed successfully. Jul 23 03:22:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-94062702-3251-4342-8085-f4ae54c5591f req-ec9c3f89-f7bb-4036-97a2-26caf03bf251 tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-94062702-3251-4342-8085-f4ae54c5591f req-ec9c3f89-f7bb-4036-97a2-26caf03bf251 tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-94062702-3251-4342-8085-f4ae54c5591f req-ec9c3f89-f7bb-4036-97a2-26caf03bf251 tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-94062702-3251-4342-8085-f4ae54c5591f req-ec9c3f89-f7bb-4036-97a2-26caf03bf251 tempest-ServerActionsTestOtherA-58101324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d11595f-81d6-44a8-8777-d5674f79099a', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-94062702-3251-4342-8085-f4ae54c5591f req-ec9c3f89-f7bb-4036-97a2-26caf03bf251 tempest-ServerActionsTestOtherA-58101324 None] attachment_update completed successfully. Jul 23 03:22:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] GroupSnapshot dddcefea-6de1-4680-a52e-3318216e44e2: creating. Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Group snapshot dddcefea-6de1-4680-a52e-3318216e44e2: creating. {{(pid=88044) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Creating offline snapshot 367ba5f8-fb2d-4ef8-b835-3799c2c0279e of volume 50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[096098f3-a05b-4d24-8f1b-595d1ce7f1cc]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:23 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 Jul 23 03:22:23 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:24 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0" returned: 0 in 1.015s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:24 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e 1G Jul 23 03:22:24 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:25 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e 1G" returned: 0 in 0.909s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:25 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e Jul 23 03:22:25 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:25 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e" returned: 0 in 0.756s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:25 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:25 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e Jul 23 03:22:25 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:26 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e" returned: 0 in 0.450s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:26 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info Jul 23 03:22:26 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:26 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:26 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:26 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info Jul 23 03:22:26 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:27 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.info" returned: 0 in 0.407s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Creating offline snapshot 85ba1568-db7b-48a9-be74-b5adfba09ad2 of volume e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e8043b-f84a-4101-848e-e7623490df0b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:27 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b Jul 23 03:22:27 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:27 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:27 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 1G Jul 23 03:22:27 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-bc55291c-0daf-4d6d-a506-b5178085abec req-5e4e8b57-304c-46c2-84f4-6966fe93f47d tempest-ServerActionsTestOtherA-58101324 None] Terminate volume connection completed successfully. Jul 23 03:22:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-bc55291c-0daf-4d6d-a506-b5178085abec req-5e4e8b57-304c-46c2-84f4-6966fe93f47d tempest-ServerActionsTestOtherA-58101324 None] Deleting attachment 6d11595f-81d6-44a8-8777-d5674f79099a. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:22:28 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 1G" returned: 0 in 0.842s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e82cd064-e180-4381-abe7-93099fd8275b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:28 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e82cd064-e180-4381-abe7-93099fd8275b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 Jul 23 03:22:28 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-bc55291c-0daf-4d6d-a506-b5178085abec req-c0498a47-0abf-4df7-a4f0-d359f941b401 tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:29 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e82cd064-e180-4381-abe7-93099fd8275b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 Jul 23 03:22:29 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info Jul 23 03:22:29 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info" returned: 0 in 0.248s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info Jul 23 03:22:29 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.info" returned: 0 in 0.320s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-bc55291c-0daf-4d6d-a506-b5178085abec req-c0498a47-0abf-4df7-a4f0-d359f941b401 tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.081s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-bc55291c-0daf-4d6d-a506-b5178085abec req-c0498a47-0abf-4df7-a4f0-d359f941b401 tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-bc55291c-0daf-4d6d-a506-b5178085abec req-c0498a47-0abf-4df7-a4f0-d359f941b401 tempest-ServerActionsTestOtherA-58101324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fd631c3-2177-4671-867f-511531b2537b', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-bc55291c-0daf-4d6d-a506-b5178085abec req-c0498a47-0abf-4df7-a4f0-d359f941b401 tempest-ServerActionsTestOtherA-58101324 None] attachment_update completed successfully. Jul 23 03:22:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2c1509e4-0487-4781-b952-08cb3c68ede6 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot dddcefea-6de1-4680-a52e-3318216e44e2: created successfully Jul 23 03:22:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] group_snapshot dddcefea-6de1-4680-a52e-3318216e44e2: deleting Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] group_snapshot dddcefea-6de1-4680-a52e-3318216e44e2: deleting {{(pid=88044) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-367ba5f8-fb2d-4ef8-b835-3799c2c0279e" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-367ba5f8-fb2d-4ef8-b835-3799c2c0279e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Deleting offline snapshot 367ba5f8-fb2d-4ef8-b835-3799c2c0279e of volume 50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] snapshot_file for this snap is: volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b66e8-5da0-4015-a641-885212599179]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:30 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e Jul 23 03:22:30 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e" returned: 0 in 0.462s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50ba13e7-af3c-4554-8b7c-b36068bebae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[910cfb2c-4b48-48fe-93ba-08769d8d5947]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:31 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 Jul 23 03:22:31 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0" returned: 0 in 0.617s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:31 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e Jul 23 03:22:32 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:32 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e" returned: 0 in 0.966s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:32 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e Jul 23 03:22:32 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0.367ba5f8-fb2d-4ef8-b835-3799c2c0279e" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-367ba5f8-fb2d-4ef8-b835-3799c2c0279e" released by "_delete_snapshot" :: held 2.618s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" released by "delete_snapshot" :: held 2.661s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-85ba1568-db7b-48a9-be74-b5adfba09ad2" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-85ba1568-db7b-48a9-be74-b5adfba09ad2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Deleting offline snapshot 85ba1568-db7b-48a9-be74-b5adfba09ad2 of volume e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] snapshot_file for this snap is: volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cf819-19a9-4eb3-867a-ec72cde55e04]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:33 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 Jul 23 03:22:33 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e82cd064-e180-4381-abe7-93099fd8275b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86cba9-aedb-44c9-b8ad-412cfc067fec]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:34 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b Jul 23 03:22:34 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:34 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b" returned: 0 in 0.601s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:34 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 Jul 23 03:22:34 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:35 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:35 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2 Jul 23 03:22:35 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:35 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b.85ba1568-db7b-48a9-be74-b5adfba09ad2" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-85ba1568-db7b-48a9-be74-b5adfba09ad2" released by "_delete_snapshot" :: held 1.976s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" released by "delete_snapshot" :: held 2.014s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:35 devstack cinder-volume[88044]: WARNING cinder.quota [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-297581320 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-297581320, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:35 devstack cinder-volume[88044]: WARNING cinder.quota [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-297581320 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-297581320, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['7aba9dc5-4372-4701-a470-199a6c7d9a73', '3288b155-2bcf-4cda-b1b7-6e7149d30d36', '60c28406-af5d-4cd5-ba33-e0d7c9d84be0', 'a34851c0-6a1e-490d-936f-dda0499103b9'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:35 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:22:35 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['5ef8bd8d-b1a5-489e-a458-b47548313a4f', 'b45b93ad-da63-4d39-8bf9-a10d05fdface', '026a9dd2-c3be-4ce4-be02-50cb9a6459bd', '470c5570-0d30-4f53-a5ad-39ae2faae2ee'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1e5ffd83-4366-456c-b536-c8e6f5a20cad tempest-GroupSnapshotsTest-2053043439 None] group_snapshot dddcefea-6de1-4680-a52e-3318216e44e2: deleted successfully Jul 23 03:22:36 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.611s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:22:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" acquired by "delete_volume" :: waited 0.073s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c2c75-dfc2-4db4-92c4-62c58a0da6c3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (98e4370c-0229-4f29-8258-46f0d094fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83418c7-1f39-4c01-aeda-35337635d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83418c7-1f39-4c01-aeda-35337635d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-326622424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f296f1-bfb3-46f0-95db-cf98ac00af63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:37Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3a1f9-e36a-4210-9ada-bf7c8f7bb9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3a1f9-e36a-4210-9ada-bf7c8f7bb9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee847e9-e98a-4adb-aaa8-6d67bd6a3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee847e9-e98a-4adb-aaa8-6d67bd6a3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f296f1-bfb3-46f0-95db-cf98ac00af63', 'volume_name': 'volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba32ec4-9c2a-4993-949b-162100427c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba32ec4-9c2a-4993-949b-162100427c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 Jul 23 03:22:37 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b44754e-3c22-4c58-96ac-6644540caa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Volume e8f296f1-bfb3-46f0-95db-cf98ac00af63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63', 'volume_size': 1} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-326622424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f296f1-bfb3-46f0-95db-cf98ac00af63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:37Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Creating volume e8f296f1-bfb3-46f0-95db-cf98ac00af63 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:37 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:22:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:37 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 1073741824 Jul 23 03:22:37 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:38 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0" returned: 0 in 0.729s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:38 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0 Jul 23 03:22:38 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:38 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 1073741824" returned: 0 in 0.656s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:38 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 Jul 23 03:22:38 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:38 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-50ba13e7-af3c-4554-8b7c-b36068bebae0" returned: 0 in 0.314s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-50ba13e7-af3c-4554-8b7c-b36068bebae0" released by "delete_volume" :: held 1.306s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb20d38-969b-49d9-997e-92b829b1a2d8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:38 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b Jul 23 03:22:38 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b44754e-3c22-4c58-96ac-6644540caa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7012df5-1dc2-4877-8c8d-321ca4fba7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Volume volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 (e8f296f1-bfb3-46f0-95db-cf98ac00af63): created successfully Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7012df5-1dc2-4877-8c8d-321ca4fba7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (98e4370c-0229-4f29-8258-46f0d094fd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ec76beb3-64a7-4d3a-8f44-f25e55431125 tempest-AttachVolumeTestJSON-1475294373 None] Created volume successfully. Jul 23 03:22:38 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b Jul 23 03:22:39 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e82cd064-e180-4381-abe7-93099fd8275b" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-e82cd064-e180-4381-abe7-93099fd8275b" released by "delete_volume" :: held 0.817s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['4cb37393-a23a-4b10-97f5-3976b24a0c0d'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:39 devstack cinder-volume[88044]: WARNING cinder.quota [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-297581320 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-297581320, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['d64098a2-a906-4485-bbc0-70e18470e742', '59141654-bea4-4ef3-a7ce-f70e926c1c94', 'dda115cc-1863-45ff-9943-901defd11438', '669b102f-2882-4410-8485-5300a0349b95'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['654014ba-4a53-4232-ba1c-a399b691b156', '4666c451-7ed6-4ecb-8172-221ab90df10f', '0942bd71-cf5d-49ea-989a-34619677fb9f', '6c3f670f-c2e1-42f6-a574-96f67de39b7e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:22:39 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:40 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.350s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4e528bb6-b63d-48e7-849b-07c849ab1f7e tempest-GroupSnapshotsTest-2053043439 None] Delete group completed successfully. Jul 23 03:22:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-118555a9-064e-4ae2-a701-396884d7c484 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-1842397795: creating Jul 23 03:22:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-118555a9-064e-4ae2-a701-396884d7c484 tempest-GroupSnapshotsTest-2053043439 None] Group tempest-GroupSnapshotsTest-Group-1842397795: created successfully Jul 23 03:22:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-118555a9-064e-4ae2-a701-396884d7c484 tempest-GroupSnapshotsTest-2053043439 None] Create group completed successfully. Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b415431e-c980-4db0-b727-9fb7d7b483f0 req-43c3f333-0d34-4fc7-a50f-b88bce94513a tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b415431e-c980-4db0-b727-9fb7d7b483f0 req-43c3f333-0d34-4fc7-a50f-b88bce94513a tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b415431e-c980-4db0-b727-9fb7d7b483f0 req-43c3f333-0d34-4fc7-a50f-b88bce94513a tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b415431e-c980-4db0-b727-9fb7d7b483f0 req-43c3f333-0d34-4fc7-a50f-b88bce94513a tempest-AttachVolumeTestJSON-1475294373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50a0704d-1323-4725-ae8e-250fa10af699', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-b415431e-c980-4db0-b727-9fb7d7b483f0 req-43c3f333-0d34-4fc7-a50f-b88bce94513a tempest-AttachVolumeTestJSON-1475294373 None] attachment_update completed successfully. Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (d89ce3ec-adb0-400c-9bf1-e929bd0d9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac74059-5542-4fcf-90c3-42b28aa4fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac74059-5542-4fcf-90c3-42b28aa4fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350269687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f8d0dbe-5e6f-4684-b2fe-9ca99b0d5f35,host='devstack@QuobyteHD#QuobyteHD',id=ada6d911-ed12-4568-a224-a40957d1c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c8a03f0-bd09-4ab7-9491-b3ee11cef8f1),volume_type_id=8c8a03f0-bd09-4ab7-9491-b3ee11cef8f1)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccefc9a-85cd-407e-bc00-7a2e8737c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccefc9a-85cd-407e-bc00-7a2e8737c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5a6c6e-331b-4ef5-88c8-1254d4ce2d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5a6c6e-331b-4ef5-88c8-1254d4ce2d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada6d911-ed12-4568-a224-a40957d1c29a', 'volume_name': 'volume-ada6d911-ed12-4568-a224-a40957d1c29a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6852ce43-ee57-41b4-bd81-c02bd686d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6852ce43-ee57-41b4-bd81-c02bd686d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dacb066-c12b-4638-b9c4-d8b4e8a2e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Volume ada6d911-ed12-4568-a224-a40957d1c29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada6d911-ed12-4568-a224-a40957d1c29a', 'volume_size': 1} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f8d0dbe-5e6f-4684-b2fe-9ca99b0d5f35,created_at=2026-07-23T01:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350269687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f8d0dbe-5e6f-4684-b2fe-9ca99b0d5f35,host='devstack@QuobyteHD#QuobyteHD',id=ada6d911-ed12-4568-a224-a40957d1c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a01647f4d406e9b403090da8da7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='fc0b2ac90d4f45bfbe2433042bc5e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c8a03f0-bd09-4ab7-9491-b3ee11cef8f1),volume_type_id=8c8a03f0-bd09-4ab7-9491-b3ee11cef8f1)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Creating volume ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:42 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:22:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:42 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a 1073741824 Jul 23 03:22:42 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a 1073741824" returned: 0 in 0.627s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a Jul 23 03:22:43 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dacb066-c12b-4638-b9c4-d8b4e8a2e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada6d911-ed12-4568-a224-a40957d1c29a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb867284-7c5a-493e-a5bd-bf25fd610322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Volume volume-ada6d911-ed12-4568-a224-a40957d1c29a (ada6d911-ed12-4568-a224-a40957d1c29a): created successfully Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb867284-7c5a-493e-a5bd-bf25fd610322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Flow 'volume_create_manager' (d89ce3ec-adb0-400c-9bf1-e929bd0d9260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-49e46bc2-9e94-4e73-874b-0d95839abe98 tempest-GroupSnapshotsTest-2053043439 None] Created volume successfully. Jul 23 03:22:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] GroupSnapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: creating. Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Group snapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: creating. {{(pid=88044) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Creating offline snapshot 41ed6da1-6937-45f2-808a-2249879c0d34 of volume ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d826f132-9f12-4543-9c03-a144601b2838]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a Jul 23 03:22:45 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 1G Jul 23 03:22:46 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 1G" returned: 0 in 1.150s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada6d911-ed12-4568-a224-a40957d1c29a -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada6d911-ed12-4568-a224-a40957d1c29a -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 Jul 23 03:22:47 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada6d911-ed12-4568-a224-a40957d1c29a -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34" returned: 0 in 0.540s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 Jul 23 03:22:47 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:48 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:48 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info Jul 23 03:22:48 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:48 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info" returned: 0 in 0.751s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:49 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info Jul 23 03:22:49 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:49 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.info" returned: 0 in 0.651s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8a3d037f-c646-4a7d-ba02-0dccb40b1ad9 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: created successfully Jul 23 03:22:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: deleting Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: deleting {{(pid=88044) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-41ed6da1-6937-45f2-808a-2249879c0d34" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-41ed6da1-6937-45f2-808a-2249879c0d34" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Deleting offline snapshot 41ed6da1-6937-45f2-808a-2249879c0d34 of volume ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] snapshot_file for this snap is: volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c01c915-38e9-4af8-ae50-e72328c93fb9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:50 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 Jul 23 03:22:50 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:51 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34" returned: 0 in 0.586s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ada6d911-ed12-4568-a224-a40957d1c29a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a5a195-9d51-458c-876c-ebb6e6ebf1b5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:51 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a Jul 23 03:22:51 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:51 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a" returned: 0 in 0.623s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:51 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 Jul 23 03:22:51 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34" returned: 0 in 0.663s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:52 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34 Jul 23 03:22:52 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a.41ed6da1-6937-45f2-808a-2249879c0d34" returned: 0 in 0.446s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-41ed6da1-6937-45f2-808a-2249879c0d34" released by "_delete_snapshot" :: held 2.486s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" released by "delete_snapshot" :: held 2.514s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:52 devstack cinder-volume[88044]: WARNING cinder.quota [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1804317739 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1804317739, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:52 devstack cinder-volume[88044]: WARNING cinder.quota [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1804317739 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1804317739, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['0d03e13e-05b5-4864-a70f-614310a6d50c', 'fbab5dd7-de6e-4c2c-906e-ff0c1413fece', 'b781cb60-44a3-43ab-a51c-1165359f60b2', '03595ea7-9f3a-4eb7-8c4b-dfb9fe7b14f2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dd894d07-840a-4aa8-ba78-169951520b29 tempest-GroupSnapshotsTest-2053043439 None] group_snapshot 513d7587-c23c-4d89-9f08-5b00b09388c9: deleted successfully Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[593c88a3-83df-4652-899c-67cb868972ba]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:54 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a Jul 23 03:22:54 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:54 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a" returned: 0 in 0.429s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:54 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a Jul 23 03:22:54 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:55 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ada6d911-ed12-4568-a224-a40957d1c29a" returned: 0 in 0.266s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Lock "cinder-quobyte-ada6d911-ed12-4568-a224-a40957d1c29a" released by "delete_volume" :: held 0.783s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=90,cinder:SELECT=130,cinder:INSERT=22,cinder:DELETE=4 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=109,cinder:SELECT=112,cinder:INSERT=21,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['52b81494-2454-4d58-ad1c-c40bba5e5058'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:55 devstack cinder-volume[88044]: WARNING cinder.quota [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1804317739 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1804317739, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Created reservations ['242732ff-f11c-4710-a637-0d5e39f8d299', '442171c5-fb84-4d81-8308-ed753ebe82f4', '8e6db76e-9885-4ca0-89e3-113d56125102', 'fd4d6c98-12f0-4c3d-890e-3feb95bb63f1'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:55 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:22:55 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:55 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.434s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3425a189-19b3-42b5-8bf1-4dbc36943866 tempest-GroupSnapshotsTest-2053043439 None] Delete group completed successfully. Jul 23 03:22:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-a328f47e-a4ed-4d9f-a786-13de29be0f29 req-5ab8aa85-4b79-43b6-aba4-885fc60bf44a tempest-AttachVolumeNegativeTest-515070177 None] Terminate volume connection completed successfully. Jul 23 03:22:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-a328f47e-a4ed-4d9f-a786-13de29be0f29 req-5ab8aa85-4b79-43b6-aba4-885fc60bf44a tempest-AttachVolumeNegativeTest-515070177 None] Deleting attachment a7ff8f60-85f4-4bf3-a5da-46c8825bcd17. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-1a460e0b-7d67-4463-867d-38e36089b9ea req-7e96b325-70c0-4f33-8a0c-86d4e017c36b tempest-ServerActionsTestOtherA-58101324 None] Terminate volume connection completed successfully. Jul 23 03:23:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-1a460e0b-7d67-4463-867d-38e36089b9ea req-7e96b325-70c0-4f33-8a0c-86d4e017c36b tempest-ServerActionsTestOtherA-58101324 None] Deleting attachment 7fd631c3-2177-4671-867f-511531b2537b. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "cinder-21aebb1d-48a5-4d3d-97da-6ec4e709f88b-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "cinder-21aebb1d-48a5-4d3d-97da-6ec4e709f88b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "cinder-quobyte-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "cinder-quobyte-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea57258-bef2-4e4a-b030-5f030c1302d1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:06 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b Jul 23 03:23:06 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" returned: 0 in 0.473s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b Jul 23 03:23:07 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" returned: 0 in 0.335s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "cinder-quobyte-21aebb1d-48a5-4d3d-97da-6ec4e709f88b" released by "delete_volume" :: held 0.868s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Created reservations ['23805950-b7fb-40f0-a2b7-95383f5c9fcb', '271d15da-ff71-42a0-a437-95bb9732bea2', 'fbd35f2a-94ee-4130-bea0-60c2f4ac9f02', 'e7ac9c2c-316d-4c4e-abb3-3f2f17368755'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:23:07 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:08 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.342s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Deleted volume successfully. Jul 23 03:23:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-152079e6-e751-4f6d-abde-dbb3b478912f tempest-ServerActionsTestOtherA-58101324 None] Lock "cinder-21aebb1d-48a5-4d3d-97da-6ec4e709f88b-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-a1c9d201-9fdf-48f3-b08d-0a426a10c460 req-c1b7bf4f-84e6-402f-8ba4-c6214bb7f92d tempest-AttachVolumeTestJSON-1475294373 None] Terminate volume connection completed successfully. Jul 23 03:23:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-a1c9d201-9fdf-48f3-b08d-0a426a10c460 req-c1b7bf4f-84e6-402f-8ba4-c6214bb7f92d tempest-AttachVolumeTestJSON-1475294373 None] Deleting attachment 50a0704d-1323-4725-ae8e-250fa10af699. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:17 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:INSERT=6 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Flow 'volume_create_manager' (b63e6adb-9a88-4750-b9a9-f3d45ffd1c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8515d6e1-d3fe-4cc0-9660-3387fa8c90fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8515d6e1-d3fe-4cc0-9660-3387fa8c90fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-672075897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa7bac1-ca63-4c4a-aa10-d6665450cfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8387ac1d84342a4c5f88a90685a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:29Z,use_quota=True,user_id='e8864dd91e924498819d11ff938c6632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e72777-efbe-4ee6-a83c-ce54986dc1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e72777-efbe-4ee6-a83c-ce54986dc1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fba4f00-f313-4069-8f18-83b6506dad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fba4f00-f313-4069-8f18-83b6506dad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa7bac1-ca63-4c4a-aa10-d6665450cfe4', 'volume_name': 'volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d43c651-76f8-4c50-a711-6c1098c19573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d43c651-76f8-4c50-a711-6c1098c19573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b6576-197f-455e-bcf9-2f76de081e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume 4aa7bac1-ca63-4c4a-aa10-d6665450cfe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4', 'volume_size': 1} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-672075897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa7bac1-ca63-4c4a-aa10-d6665450cfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8387ac1d84342a4c5f88a90685a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:29Z,use_quota=True,user_id='e8864dd91e924498819d11ff938c6632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Creating volume 4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:29 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:29 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 1073741824 Jul 23 03:23:29 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:29 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 1073741824" returned: 0 in 0.755s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:29 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 Jul 23 03:23:29 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" returned: 0 in 0.317s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b6576-197f-455e-bcf9-2f76de081e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c755f2-0a90-47c2-ac8c-5d00bd45c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 (4aa7bac1-ca63-4c4a-aa10-d6665450cfe4): created successfully Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c755f2-0a90-47c2-ac8c-5d00bd45c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Flow 'volume_create_manager' (b63e6adb-9a88-4750-b9a9-f3d45ffd1c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cd3b2675-07f0-4522-a80e-799fc77d8696 tempest-VolumeQuotasAdminTestJSON-637503385 None] Created volume successfully. Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "cinder-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "cinder-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "cinder-quobyte-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "cinder-quobyte-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c9b79-7407-4143-98ec-a82866f3425c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:31 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 Jul 23 03:23:31 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" returned: 0 in 0.419s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:31 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4 Jul 23 03:23:31 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" returned: 0 in 0.291s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "cinder-quobyte-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4" released by "delete_volume" :: held 0.767s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Created reservations ['f09ddd79-5925-463a-8b56-def5213cea6a', '00b9628d-48de-461e-8e28-1ca1c0d2a3ca', '23872db2-8fb4-4617-ae2a-5fdff1b4eaef', '19b9575b-d2ff-40d3-8147-9a0a6a43e16b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:23:32 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Deleted volume successfully. Jul 23 03:23:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d1d997e3-47ad-47fb-9103-e33af0565e3b tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "cinder-4aa7bac1-ca63-4c4a-aa10-d6665450cfe4-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Flow 'volume_create_manager' (d3944849-1f20-464c-bc4d-06f036733fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b230be-bbde-4d73-9ae1-fd3a63f360f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b230be-bbde-4d73-9ae1-fd3a63f360f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-600373441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1070d06a-66cd-45bf-8eca-109dea61b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8387ac1d84342a4c5f88a90685a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='e8864dd91e924498819d11ff938c6632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd60624-29ac-498c-ab79-cfc887c00659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd60624-29ac-498c-ab79-cfc887c00659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebae11e-6ce7-47b9-818f-32c3fc009388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebae11e-6ce7-47b9-818f-32c3fc009388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1070d06a-66cd-45bf-8eca-109dea61b249', 'volume_name': 'volume-1070d06a-66cd-45bf-8eca-109dea61b249', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67827b7-342d-481f-a2d5-f7a341b16c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67827b7-342d-481f-a2d5-f7a341b16c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c41ce-c945-48a1-bdc9-587c96c0d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume 1070d06a-66cd-45bf-8eca-109dea61b249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1070d06a-66cd-45bf-8eca-109dea61b249', 'volume_size': 1} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-600373441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1070d06a-66cd-45bf-8eca-109dea61b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8387ac1d84342a4c5f88a90685a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='e8864dd91e924498819d11ff938c6632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Creating volume 1070d06a-66cd-45bf-8eca-109dea61b249 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:23:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 1073741824 Jul 23 03:23:33 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:34 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 1073741824" returned: 0 in 0.607s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:34 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 Jul 23 03:23:34 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:34 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c41ce-c945-48a1-bdc9-587c96c0d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1070d06a-66cd-45bf-8eca-109dea61b249', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d3a38-c1a8-4d05-ab75-706bd0c7484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Volume volume-1070d06a-66cd-45bf-8eca-109dea61b249 (1070d06a-66cd-45bf-8eca-109dea61b249): created successfully Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d3a38-c1a8-4d05-ab75-706bd0c7484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Flow 'volume_create_manager' (d3944849-1f20-464c-bc4d-06f036733fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0f2563c0-2af9-44b1-a807-396b24fb0a9d tempest-VolumeQuotasAdminTestJSON-637503385 None] Created volume successfully. Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:35 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:23:35 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:36 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:23:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:23:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b3b480e2-3a63-4651-bf36-583ee2b064a5 tempest-VolumeQuotasAdminTestJSON-436928037 None] Transfer volume completed successfully. Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Acquiring lock "cinder-1070d06a-66cd-45bf-8eca-109dea61b249-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "cinder-1070d06a-66cd-45bf-8eca-109dea61b249-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Acquiring lock "cinder-quobyte-1070d06a-66cd-45bf-8eca-109dea61b249" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "cinder-quobyte-1070d06a-66cd-45bf-8eca-109dea61b249" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4c537c-7d0b-490a-aad2-0bfa23e1f555]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:37 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 Jul 23 03:23:37 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249" returned: 0 in 0.654s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:38 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249 Jul 23 03:23:38 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:38 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1070d06a-66cd-45bf-8eca-109dea61b249" returned: 0 in 0.275s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "cinder-quobyte-1070d06a-66cd-45bf-8eca-109dea61b249" released by "delete_volume" :: held 0.996s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Created reservations ['d76fe4e0-96b4-4a7c-b7ba-494c7f19a470', '44101d0e-30ab-4f66-8c0c-a80c27604489', '8ab9b08f-5e6b-44d9-8f3d-785c20e07d51', 'be17c892-9fb0-4644-9540-0689ea2bea94'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:38 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:23:38 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:38 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.333s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Deleted volume successfully. Jul 23 03:23:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0c9d88b8-4225-453f-9946-579f13592954 tempest-VolumeQuotasAdminTestJSON-477922650 None] Lock "cinder-1070d06a-66cd-45bf-8eca-109dea61b249-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (68def17e-2602-41f9-9213-4e6d5b6d36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c96dd3-ecb4-4039-b3b1-15a7d5c4c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c96dd3-ecb4-4039-b3b1-15a7d5c4c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1787799253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37a2c82-451c-4a71-b16d-3ae6c59155f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:43Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305602c-5168-4c1d-935a-0b6a51e918a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305602c-5168-4c1d-935a-0b6a51e918a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d109e8b2-bbec-43f5-ac66-f1896f27bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d109e8b2-bbec-43f5-ac66-f1896f27bcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37a2c82-451c-4a71-b16d-3ae6c59155f0', 'volume_name': 'volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b788f30f-4a77-4945-9b33-23c06e84385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b788f30f-4a77-4945-9b33-23c06e84385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d050e04-189f-4a00-b15f-0f3a35731a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Volume b37a2c82-451c-4a71-b16d-3ae6c59155f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0', 'volume_size': 1} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1787799253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37a2c82-451c-4a71-b16d-3ae6c59155f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:43Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Creating volume b37a2c82-451c-4a71-b16d-3ae6c59155f0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:42 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:23:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:42 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 1073741824 Jul 23 03:23:42 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 1073741824" returned: 0 in 0.563s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 Jul 23 03:23:43 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0" returned: 0 in 0.266s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d050e04-189f-4a00-b15f-0f3a35731a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf131413-7bc7-4ded-8a93-e700519ec10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Volume volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 (b37a2c82-451c-4a71-b16d-3ae6c59155f0): created successfully Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf131413-7bc7-4ded-8a93-e700519ec10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (68def17e-2602-41f9-9213-4e6d5b6d36bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b2bad9b6-33d0-458d-8a1b-1f3d4ab98711 tempest-AttachVolumeNegativeTest-515070177 None] Created volume successfully. Jul 23 03:23:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-3adbfc33-dfe9-4ec7-a205-eadf3a3d61ad req-b2ed1e0d-b75d-4828-a9f4-90a08e8c6aba tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-3adbfc33-dfe9-4ec7-a205-eadf3a3d61ad req-b2ed1e0d-b75d-4828-a9f4-90a08e8c6aba tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-3adbfc33-dfe9-4ec7-a205-eadf3a3d61ad req-b2ed1e0d-b75d-4828-a9f4-90a08e8c6aba tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-3adbfc33-dfe9-4ec7-a205-eadf3a3d61ad req-b2ed1e0d-b75d-4828-a9f4-90a08e8c6aba tempest-AttachVolumeNegativeTest-515070177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52cb5b8c-4f2b-42fd-9e09-0840090f302f', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:23:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-3adbfc33-dfe9-4ec7-a205-eadf3a3d61ad req-b2ed1e0d-b75d-4828-a9f4-90a08e8c6aba tempest-AttachVolumeNegativeTest-515070177 None] attachment_update completed successfully. Jul 23 03:23:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-3c1076dc-34e0-4ced-becc-4fb26caa0503 req-58665395-7fb5-47b4-8d5c-1e3eff0a22c0 tempest-AttachVolumeNegativeTest-515070177 None] Terminate volume connection completed successfully. Jul 23 03:23:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-3c1076dc-34e0-4ced-becc-4fb26caa0503 req-58665395-7fb5-47b4-8d5c-1e3eff0a22c0 tempest-AttachVolumeNegativeTest-515070177 None] Deleting attachment 52cb5b8c-4f2b-42fd-9e09-0840090f302f. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Flow 'volume_create_manager' (7676c49d-9f6d-4aba-899c-e3398e19f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647dce3a-7397-4bb7-88d5-b10c92355763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647dce3a-7397-4bb7-88d5-b10c92355763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1451893050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb64f9ca-e32d-4452-b3cd-53874d25a7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f93ccbafd4e44838321a7547152656c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:52Z,use_quota=True,user_id='b46b71162f5f4857bb18b8c31ed7be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd4dcc9-0ff8-494d-8e1e-81d325a48052),volume_type_id=dfd4dcc9-0ff8-494d-8e1e-81d325a48052)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c26332f-e945-4cde-8610-baae129a65b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c26332f-e945-4cde-8610-baae129a65b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6f136d-8154-4b08-a44e-498a26cb5f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6f136d-8154-4b08-a44e-498a26cb5f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb64f9ca-e32d-4452-b3cd-53874d25a7c1', 'volume_name': 'volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fbdefd-4f5e-4a65-ad87-dacec1eb7789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fbdefd-4f5e-4a65-ad87-dacec1eb7789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0eb6b2e-283d-4407-9b8d-ef644e1cc322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:52 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Volume fb64f9ca-e32d-4452-b3cd-53874d25a7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1', 'volume_size': 1} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1451893050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb64f9ca-e32d-4452-b3cd-53874d25a7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f93ccbafd4e44838321a7547152656c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:52Z,use_quota=True,user_id='b46b71162f5f4857bb18b8c31ed7be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd4dcc9-0ff8-494d-8e1e-81d325a48052),volume_type_id=dfd4dcc9-0ff8-494d-8e1e-81d325a48052)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Creating volume fb64f9ca-e32d-4452-b3cd-53874d25a7c1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:52 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:23:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:52 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 1073741824 Jul 23 03:23:52 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:53 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 1073741824" returned: 0 in 0.607s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:53 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 Jul 23 03:23:53 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:53 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" returned: 0 in 0.351s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0eb6b2e-283d-4407-9b8d-ef644e1cc322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013c2b65-9225-4755-b660-0a41dfcd7873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Volume volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 (fb64f9ca-e32d-4452-b3cd-53874d25a7c1): created successfully Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013c2b65-9225-4755-b660-0a41dfcd7873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Flow 'volume_create_manager' (7676c49d-9f6d-4aba-899c-e3398e19f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51197940-f721-48cd-8f1a-5a04167b4618 tempest-VolumeTypesAccessTest-745862247 None] Created volume successfully. Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Acquiring lock "cinder-fb64f9ca-e32d-4452-b3cd-53874d25a7c1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "cinder-fb64f9ca-e32d-4452-b3cd-53874d25a7c1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Acquiring lock "cinder-quobyte-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "cinder-quobyte-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec55c5b-44e7-4134-a0b0-9f7f1ad17b77]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:55 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 Jul 23 03:23:55 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:55 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" returned: 0 in 0.867s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:55 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1 Jul 23 03:23:55 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:56 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" returned: 0 in 0.545s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "cinder-quobyte-fb64f9ca-e32d-4452-b3cd-53874d25a7c1" released by "delete_volume" :: held 1.501s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:56 devstack cinder-volume[88044]: WARNING cinder.quota [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1068973386 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1068973386, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:56 devstack cinder-volume[88044]: WARNING cinder.quota [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1068973386 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1068973386, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Created reservations ['52626a20-b0f8-45ab-9344-e337a274a9da', '8be90522-e043-4461-9e7d-7d0161dca153', '97161ba9-1eb7-4b23-bfff-08434cf278e2', 'a55f6876-7c61-462e-aabc-c3bc44eb68f4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:56 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:23:56 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:57 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.500s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Deleted volume successfully. Jul 23 03:23:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-597bb934-05a7-4ae4-bd3e-9bd024910f36 tempest-VolumeTypesAccessTest-745862247 None] Lock "cinder-fb64f9ca-e32d-4452-b3cd-53874d25a7c1-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:06 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=29,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:07 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=37,cinder:SELECT=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Flow 'volume_create_manager' (76267800-06a1-4286-8481-4ea9fa2ca38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43a90ce-d558-47d1-b57c-02dffd1a537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43a90ce-d558-47d1-b57c-02dffd1a537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-444671784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba286a6-26c9-4eed-9562-604099f0f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4599fef8fa9b4fb5a10d0a6c8894d0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:15Z,use_quota=True,user_id='21608cfa664e4650bdd2155662a3c106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72738301-7b8b-4994-81af-9c32ccf4d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72738301-7b8b-4994-81af-9c32ccf4d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355e1a65-3c59-4ce9-9aa1-83725383be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355e1a65-3c59-4ce9-9aa1-83725383be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba286a6-26c9-4eed-9562-604099f0f7e5', 'volume_name': 'volume-9ba286a6-26c9-4eed-9562-604099f0f7e5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e8764a-628c-45e5-b733-15a5033cefb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e8764a-628c-45e5-b733-15a5033cefb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70348da1-c434-4522-b0be-3d7876369233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Volume 9ba286a6-26c9-4eed-9562-604099f0f7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba286a6-26c9-4eed-9562-604099f0f7e5', 'volume_size': 1} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-444671784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba286a6-26c9-4eed-9562-604099f0f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4599fef8fa9b4fb5a10d0a6c8894d0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:15Z,use_quota=True,user_id='21608cfa664e4650bdd2155662a3c106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Creating volume 9ba286a6-26c9-4eed-9562-604099f0f7e5 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:15 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:24:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:15 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 1073741824 Jul 23 03:24:15 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:16 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 1073741824" returned: 0 in 0.970s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:16 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 Jul 23 03:24:16 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:16 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5" returned: 0 in 0.400s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70348da1-c434-4522-b0be-3d7876369233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba286a6-26c9-4eed-9562-604099f0f7e5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741b4931-0ece-43dc-8432-0f3e3e473256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Volume volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 (9ba286a6-26c9-4eed-9562-604099f0f7e5): created successfully Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741b4931-0ece-43dc-8432-0f3e3e473256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Flow 'volume_create_manager' (76267800-06a1-4286-8481-4ea9fa2ca38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e468e728-2b53-4556-ab32-041fe9986dd1 tempest-ServerRescueNegativeTestJSON-87286440 None] Created volume successfully. Jul 23 03:24:26 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:27 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:35 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:24:35 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:36 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.323s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:24:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Acquiring lock "cinder-9ba286a6-26c9-4eed-9562-604099f0f7e5-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "cinder-9ba286a6-26c9-4eed-9562-604099f0f7e5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Acquiring lock "cinder-quobyte-9ba286a6-26c9-4eed-9562-604099f0f7e5" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "cinder-quobyte-9ba286a6-26c9-4eed-9562-604099f0f7e5" acquired by "delete_volume" :: waited 0.048s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f0b051-62a0-44e1-a00a-0cc524b1efcf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:43 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 Jul 23 03:24:43 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5" returned: 0 in 0.809s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:44 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5 Jul 23 03:24:44 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9ba286a6-26c9-4eed-9562-604099f0f7e5" returned: 0 in 0.355s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "cinder-quobyte-9ba286a6-26c9-4eed-9562-604099f0f7e5" released by "delete_volume" :: held 1.274s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:44 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Created reservations ['e5f7f6b1-e0e0-4c37-a292-14ca9a01e81f', '5a64ebcc-0d4f-4c51-8dc7-52307ca70999', '88aedc05-0538-4396-b2c7-42e559b7d6ad', 'f28058bf-c01c-4856-8971-0e6f61111410'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:45 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:24:45 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:45 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.540s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Deleted volume successfully. Jul 23 03:24:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c744e59a-986a-443c-b6db-8eae496a896f tempest-ServerRescueNegativeTestJSON-87286440 None] Lock "cinder-9ba286a6-26c9-4eed-9562-604099f0f7e5-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (b1ea958b-fd61-4b89-8bd2-22d0b487c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f59d3ea-8889-4499-9506-d83ec31543b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f59d3ea-8889-4499-9506-d83ec31543b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1633122904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27251318-5b8b-40c9-9635-7fb4ea80b508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:47Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94c6ec-fdd9-4a7f-9f2a-5135508aff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94c6ec-fdd9-4a7f-9f2a-5135508aff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68f0ced-ed05-4e87-8124-e07c378d0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68f0ced-ed05-4e87-8124-e07c378d0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27251318-5b8b-40c9-9635-7fb4ea80b508', 'volume_name': 'volume-27251318-5b8b-40c9-9635-7fb4ea80b508', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f42d13-8776-4dd6-bbd1-d3f0fc51a403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f42d13-8776-4dd6-bbd1-d3f0fc51a403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268b2113-bee6-4cf7-8f92-74d0e28653df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Volume 27251318-5b8b-40c9-9635-7fb4ea80b508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27251318-5b8b-40c9-9635-7fb4ea80b508', 'volume_size': 1} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1633122904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27251318-5b8b-40c9-9635-7fb4ea80b508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f01ffe145b4f9382f2c5f0467d2390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:47Z,use_quota=True,user_id='9cc3b524aff9424aa7be2b54113d7ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Creating volume 27251318-5b8b-40c9-9635-7fb4ea80b508 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:47 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:24:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:47 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 1073741824 Jul 23 03:24:47 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 1073741824" returned: 0 in 1.091s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 Jul 23 03:24:49 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508" returned: 0 in 0.732s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268b2113-bee6-4cf7-8f92-74d0e28653df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27251318-5b8b-40c9-9635-7fb4ea80b508', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06a8e09-cf96-4588-af90-6b664b065e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Volume volume-27251318-5b8b-40c9-9635-7fb4ea80b508 (27251318-5b8b-40c9-9635-7fb4ea80b508): created successfully Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06a8e09-cf96-4588-af90-6b664b065e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Flow 'volume_create_manager' (b1ea958b-fd61-4b89-8bd2-22d0b487c172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0f2eb9e4-4e41-4094-b00b-fe0aec699580 tempest-AttachVolumeNegativeTest-515070177 None] Created volume successfully. Jul 23 03:24:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-7084df75-0cce-45a9-aee9-3e9a9679f8e9 req-acfb024d-6fbe-4e61-a07d-fd3d6d29a0c9 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-7084df75-0cce-45a9-aee9-3e9a9679f8e9 req-acfb024d-6fbe-4e61-a07d-fd3d6d29a0c9 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-7084df75-0cce-45a9-aee9-3e9a9679f8e9 req-acfb024d-6fbe-4e61-a07d-fd3d6d29a0c9 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-7084df75-0cce-45a9-aee9-3e9a9679f8e9 req-acfb024d-6fbe-4e61-a07d-fd3d6d29a0c9 tempest-AttachVolumeNegativeTest-515070177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-27251318-5b8b-40c9-9635-7fb4ea80b508', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b9234b5-0c01-4465-91e7-0971e50a3adf', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:24:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-7084df75-0cce-45a9-aee9-3e9a9679f8e9 req-acfb024d-6fbe-4e61-a07d-fd3d6d29a0c9 tempest-AttachVolumeNegativeTest-515070177 None] attachment_update completed successfully. Jul 23 03:24:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-60ffdbd2-eeae-41d9-96e8-6f20c7ab69f5 req-3e594f1b-8031-4966-a5c6-72bb101ad4f6 tempest-AttachVolumeNegativeTest-515070177 None] Terminate volume connection completed successfully. Jul 23 03:24:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-60ffdbd2-eeae-41d9-96e8-6f20c7ab69f5 req-3e594f1b-8031-4966-a5c6-72bb101ad4f6 tempest-AttachVolumeNegativeTest-515070177 None] Deleting attachment 2b9234b5-0c01-4465-91e7-0971e50a3adf. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:25:03 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=13,cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-27251318-5b8b-40c9-9635-7fb4ea80b508-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-27251318-5b8b-40c9-9635-7fb4ea80b508-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-quobyte-27251318-5b8b-40c9-9635-7fb4ea80b508" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-27251318-5b8b-40c9-9635-7fb4ea80b508" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f0f5c5-1185-40ba-b692-c39aad97aa85]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:04 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 Jul 23 03:25:04 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:04 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508" returned: 0 in 0.690s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:05 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508 Jul 23 03:25:05 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:05 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-27251318-5b8b-40c9-9635-7fb4ea80b508" returned: 0 in 0.639s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-27251318-5b8b-40c9-9635-7fb4ea80b508" released by "delete_volume" :: held 1.414s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Created reservations ['95dd93c5-8cf8-45f9-a73d-bac67a9b84c6', '53f60d0f-f3c2-48c9-ab53-69b2a65cfe39', '70f1cb04-e838-409d-99a5-d051dfb585ba', 'e60744a8-0f88-4732-9b9a-7d12ef63d1ac'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:06 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:06 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-b37a2c82-451c-4a71-b16d-3ae6c59155f0-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 1.051s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Deleted volume successfully. Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-b37a2c82-451c-4a71-b16d-3ae6c59155f0-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-027b620e-b89c-476e-937b-b5093698d8d7 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-27251318-5b8b-40c9-9635-7fb4ea80b508-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-quobyte-b37a2c82-451c-4a71-b16d-3ae6c59155f0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-b37a2c82-451c-4a71-b16d-3ae6c59155f0" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f562a-1f68-481d-9628-4293cb1b8b53]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (943774cb-78fd-441e-a5cf-1e6a644c5f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c4fe63-2153-4688-9b26-2575cfbdd19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:07 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 Jul 23 03:25:07 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c4fe63-2153-4688-9b26-2575cfbdd19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664023752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b1857-2f41-4aa8-a4a8-2a924c792a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:07Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99f6f5-a9ea-4458-ab88-99ff54459149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99f6f5-a9ea-4458-ab88-99ff54459149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c206f5-daf8-4e74-b126-0a619b9b2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c206f5-daf8-4e74-b126-0a619b9b2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4b1857-2f41-4aa8-a4a8-2a924c792a2e', 'volume_name': 'volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c13f0-d0b0-45fc-9887-39f74df850d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c13f0-d0b0-45fc-9887-39f74df850d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec77317d-2d9b-452a-82f3-7b3c9238a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Volume 5b4b1857-2f41-4aa8-a4a8-2a924c792a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e', 'volume_size': 1} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664023752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b1857-2f41-4aa8-a4a8-2a924c792a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:07Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Creating volume 5b4b1857-2f41-4aa8-a4a8-2a924c792a2e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:07 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:07 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e 1073741824 Jul 23 03:25:07 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0" returned: 0 in 0.551s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:07 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0 Jul 23 03:25:07 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:08 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:08 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b37a2c82-451c-4a71-b16d-3ae6c59155f0" returned: 0 in 0.286s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e 1073741824" returned: 0 in 0.634s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-b37a2c82-451c-4a71-b16d-3ae6c59155f0" released by "delete_volume" :: held 0.908s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Created reservations ['78daae40-bfd3-4cda-830b-bd240bf33383', '1a40a9b4-7761-4ae8-a57d-3f76a0d07799', '294eaf94-50a9-45ff-8168-6dbfb5a72348', '36b388f8-8b7e-40f6-86f7-c0546c44d70d'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:08 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e Jul 23 03:25:08 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:08 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:08 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:08 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:08 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" returned: 0 in 0.510s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.354s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Deleted volume successfully. Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec77317d-2d9b-452a-82f3-7b3c9238a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596a9010-9cb1-4758-8490-bc5830e91770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Volume volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e (5b4b1857-2f41-4aa8-a4a8-2a924c792a2e): created successfully Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596a9010-9cb1-4758-8490-bc5830e91770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (943774cb-78fd-441e-a5cf-1e6a644c5f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f2ac14-53be-47a2-9a60-5375a7afeb45 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-b37a2c82-451c-4a71-b16d-3ae6c59155f0-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d5b08b25-7c7a-4756-b352-ff3686a2d99c tempest-AttachVolumeTestJSON-1475294373 None] Created volume successfully. Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-940516c9-13e3-4202-9e08-8e753bb053d0-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-940516c9-13e3-4202-9e08-8e753bb053d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "cinder-quobyte-940516c9-13e3-4202-9e08-8e753bb053d0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-940516c9-13e3-4202-9e08-8e753bb053d0" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a656a6-b883-4325-8f3f-53f6668ab250]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:10 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 Jul 23 03:25:10 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:10 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0" returned: 0 in 0.622s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:10 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0 Jul 23 03:25:10 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:11 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-940516c9-13e3-4202-9e08-8e753bb053d0" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-quobyte-940516c9-13e3-4202-9e08-8e753bb053d0" released by "delete_volume" :: held 1.348s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (593f2a31-d5fd-4cbb-a7ce-db2750bc7ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19474763-3ac9-438b-867f-8c2dda801dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19474763-3ac9-438b-867f-8c2dda801dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630881165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48acca1-8487-4184-9c74-003c0c51fd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:11Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ec827-68ec-4cc8-b213-30175122bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ec827-68ec-4cc8-b213-30175122bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df468e1b-7c0b-41cb-9df6-0478b3ae7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df468e1b-7c0b-41cb-9df6-0478b3ae7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48acca1-8487-4184-9c74-003c0c51fd34', 'volume_name': 'volume-c48acca1-8487-4184-9c74-003c0c51fd34', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b574d6-8daf-4373-873f-1a1687560132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b574d6-8daf-4373-873f-1a1687560132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f237ddf-909a-42a8-9354-b0fcd1433526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Volume c48acca1-8487-4184-9c74-003c0c51fd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48acca1-8487-4184-9c74-003c0c51fd34', 'volume_size': 1} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630881165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48acca1-8487-4184-9c74-003c0c51fd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:11Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Creating volume c48acca1-8487-4184-9c74-003c0c51fd34 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:11 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:11 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 1073741824 Jul 23 03:25:11 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-982ec678-51e0-435c-9a1b-e6a840c802d5 req-91d64d53-8353-4cd5-a5ff-bfd58b1085a3 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Created reservations ['077acc23-4271-4abe-b09d-417e79c4e1d7', '31944562-c98b-48d9-a1e8-d807638bc31f', '46d80e85-187f-4d2f-86d4-1572c63b74c0', 'bd32fcdc-7b75-40ae-adca-1e95e8b3615e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-94ab7cfb-507f-4de6-ac9e-5ab0412a6752 tempest-BackendsCapabilitiesAdminTestsJSON-1632772161 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88044) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e3746efa-4242-4021-9562-cfe4abaa3979 tempest-BackendsCapabilitiesAdminTestsJSON-1632772161 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88044) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:11 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:11 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:12 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.339s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Deleted volume successfully. Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7564d06e-9d43-4fb9-9840-7286d2033af8 tempest-AttachVolumeNegativeTest-515070177 None] Lock "cinder-940516c9-13e3-4202-9e08-8e753bb053d0-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:12 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 1073741824" returned: 0 in 0.868s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:12 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 Jul 23 03:25:12 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:12 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-982ec678-51e0-435c-9a1b-e6a840c802d5 req-91d64d53-8353-4cd5-a5ff-bfd58b1085a3 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.244s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-982ec678-51e0-435c-9a1b-e6a840c802d5 req-91d64d53-8353-4cd5-a5ff-bfd58b1085a3 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f237ddf-909a-42a8-9354-b0fcd1433526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48acca1-8487-4184-9c74-003c0c51fd34', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7aacc4-6c9e-4c8d-9a63-aee57a2c0120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:12 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Volume volume-c48acca1-8487-4184-9c74-003c0c51fd34 (c48acca1-8487-4184-9c74-003c0c51fd34): created successfully Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7aacc4-6c9e-4c8d-9a63-aee57a2c0120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (593f2a31-d5fd-4cbb-a7ce-db2750bc7ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-16a99208-4b49-4c7a-94b1-fa37ae0d11dc tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-982ec678-51e0-435c-9a1b-e6a840c802d5 req-91d64d53-8353-4cd5-a5ff-bfd58b1085a3 tempest-AttachVolumeTestJSON-1475294373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '160bcb36-df51-412c-b0c3-4308cf885dac', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:25:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-982ec678-51e0-435c-9a1b-e6a840c802d5 req-91d64d53-8353-4cd5-a5ff-bfd58b1085a3 tempest-AttachVolumeTestJSON-1475294373 None] attachment_update completed successfully. Jul 23 03:25:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f714f4-57a8-47f6-9e98-7b7a48b448c2 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34" by "attach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f714f4-57a8-47f6-9e98-7b7a48b448c2 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34" acquired by "attach_volume" :: waited 0.068s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c5f714f4-57a8-47f6-9e98-7b7a48b448c2 tempest-VolumesActionsTest-2144446915 None] Attaching volume c48acca1-8487-4184-9c74-003c0c51fd34 to instance 34a1418b-144a-464f-b058-e2d2c7fe5954 at mountpoint /dev/vdb on host None. Jul 23 03:25:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c5f714f4-57a8-47f6-9e98-7b7a48b448c2 tempest-VolumesActionsTest-2144446915 None] Attach volume completed successfully. Jul 23 03:25:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f714f4-57a8-47f6-9e98-7b7a48b448c2 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34" released by "attach_volume" :: held 0.320s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Terminate volume connection completed successfully. Jul 23 03:25:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" by "detach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Detaching volume c48acca1-8487-4184-9c74-003c0c51fd34 from instance 34a1418b-144a-464f-b058-e2d2c7fe5954. Jul 23 03:25:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Detach volume completed successfully. Jul 23 03:25:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6a17c3a-0e95-4414-a3ea-42c2975c14cf tempest-VolumesActionsTest-1723436090 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15e58627-1da6-4ac9-8138-e6359a03a726 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" by "detach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15e58627-1da6-4ac9-8138-e6359a03a726 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-15e58627-1da6-4ac9-8138-e6359a03a726 tempest-VolumesActionsTest-2144446915 None] Volume detach called, but volume not attached. Jul 23 03:25:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15e58627-1da6-4ac9-8138-e6359a03a726 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (f3f137e3-0fb9-4a63-9679-7b89016f29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4697b191-72b4-4fdb-af46-9b853f0fccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4697b191-72b4-4fdb-af46-9b853f0fccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1680654102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:17Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f260539f-7d4a-4380-b717-4f7fedd4118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f260539f-7d4a-4380-b717-4f7fedd4118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8fdf0-5cd5-4abe-99b8-aae1ae62c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8fdf0-5cd5-4abe-99b8-aae1ae62c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bffed4-fa7d-4de4-bf12-f233d0a7d3f3', 'volume_name': 'volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10747689-63f4-42f9-8794-0487239bea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10747689-63f4-42f9-8794-0487239bea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467dd369-11b6-42e1-b236-0fca9706a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Volume d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3', 'volume_size': 1} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1680654102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03a3001bf014333b91c4df0c8a8c7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:17Z,use_quota=True,user_id='3eb34768ff2c4e53961832ca8267bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Creating volume d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:17 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-quobyte-c48acca1-8487-4184-9c74-003c0c51fd34" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 1073741824 Jul 23 03:25:17 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-quobyte-c48acca1-8487-4184-9c74-003c0c51fd34" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb754c14-ffa6-4c8b-a5a1-0695dc1a08f4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 Jul 23 03:25:17 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34" returned: 0 in 0.733s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34 Jul 23 03:25:18 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 1073741824" returned: 0 in 1.002s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 Jul 23 03:25:18 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c48acca1-8487-4184-9c74-003c0c51fd34" returned: 0 in 0.527s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-quobyte-c48acca1-8487-4184-9c74-003c0c51fd34" released by "delete_volume" :: held 1.340s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:19 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Created reservations ['c4be3710-b514-4317-b98b-f56d7419a006', '169d9d0a-1da9-43b5-a0ed-bf8e7aa1a588', '2ccc60ac-0571-4865-be54-33ed007e815f', 'a9fd1f8d-a6fd-4cb7-a52e-db5e65f86e12'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467dd369-11b6-42e1-b236-0fca9706a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7efcb0c-532f-4817-b7df-232a0003965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:19 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Volume volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 (d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3): created successfully Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7efcb0c-532f-4817-b7df-232a0003965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Flow 'volume_create_manager' (f3f137e3-0fb9-4a63-9679-7b89016f29b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-74d84570-8e68-4f53-a00d-dad0b64926ba tempest-AttachVolumeTestJSON-1475294373 None] Created volume successfully. Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:19 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:19 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.604s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Deleted volume successfully. Jul 23 03:25:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3ec5e4d6-362b-4dee-abb9-b4b86679b369 tempest-VolumesActionsTest-2144446915 None] Lock "cinder-c48acca1-8487-4184-9c74-003c0c51fd34-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ec8a979d-a237-4df4-8a2c-00bff649c6f0 req-18461940-d363-40d4-92f0-4f881d046444 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ec8a979d-a237-4df4-8a2c-00bff649c6f0 req-18461940-d363-40d4-92f0-4f881d046444 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ec8a979d-a237-4df4-8a2c-00bff649c6f0 req-18461940-d363-40d4-92f0-4f881d046444 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-ec8a979d-a237-4df4-8a2c-00bff649c6f0 req-18461940-d363-40d4-92f0-4f881d046444 tempest-AttachVolumeTestJSON-1475294373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e4dd2bc-514a-40aa-a2c3-6145c47189e0', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:25:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-ec8a979d-a237-4df4-8a2c-00bff649c6f0 req-18461940-d363-40d4-92f0-4f881d046444 tempest-AttachVolumeTestJSON-1475294373 None] attachment_update completed successfully. Jul 23 03:25:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-07dcc367-b182-4ecf-a443-404a3feb995f req-bf2055e6-6d51-45d1-b88a-dd5726d1aa83 tempest-AttachVolumeTestJSON-1475294373 None] Terminate volume connection completed successfully. Jul 23 03:25:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-07dcc367-b182-4ecf-a443-404a3feb995f req-bf2055e6-6d51-45d1-b88a-dd5726d1aa83 tempest-AttachVolumeTestJSON-1475294373 None] Deleting attachment 160bcb36-df51-412c-b0c3-4308cf885dac. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (dbfdaef8-d40d-4f68-994d-621992ffe291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b900293-2bdc-4018-9183-712ebe1d9bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b900293-2bdc-4018-9183-712ebe1d9bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2130128654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:25Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88efdf8d-a9b2-4a05-9e9d-e535551c80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88efdf8d-a9b2-4a05-9e9d-e535551c80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43feaa95-28ca-4fde-ab4c-d7322f797549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43feaa95-28ca-4fde-ab4c-d7322f797549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7', 'volume_name': 'volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984e7833-20f4-493e-8373-e02c375d0b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984e7833-20f4-493e-8373-e02c375d0b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf71c2e-aece-4f69-af60-3bae8c92fdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:25 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Volume b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7', 'volume_size': 1} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2130128654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:25Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Creating volume b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:25 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:25 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 1073741824 Jul 23 03:25:25 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:25 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 1073741824" returned: 0 in 0.770s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:26 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 Jul 23 03:25:26 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-2e82c671-606a-49ab-9b3c-eda052a58cde req-0c1dcf59-df82-44cc-856b-dd11e3be345f tempest-AttachVolumeTestJSON-1475294373 None] Terminate volume connection completed successfully. Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-2e82c671-606a-49ab-9b3c-eda052a58cde req-0c1dcf59-df82-44cc-856b-dd11e3be345f tempest-AttachVolumeTestJSON-1475294373 None] Deleting attachment 6e4dd2bc-514a-40aa-a2c3-6145c47189e0. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:25:26 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" returned: 0 in 0.406s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf71c2e-aece-4f69-af60-3bae8c92fdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12764a74-4fb6-4f97-9d3f-02e0c94b8f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Volume volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 (b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7): created successfully Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12764a74-4fb6-4f97-9d3f-02e0c94b8f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (dbfdaef8-d40d-4f68-994d-621992ffe291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f5386d72-8d18-4514-9b65-e453f2626c70 tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Flow 'volume_create_manager' (dfa90656-19c3-476d-b06b-0ae800b0d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea121ad-ca18-44ee-8f55-f812e5107a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea121ad-ca18-44ee-8f55-f812e5107a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1160378687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afab187-1b3a-4bd4-9f77-f04f4f244026,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='268f8a72d2ce4aa0bd63b732bf35d22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:27Z,use_quota=True,user_id='6c5d142fbf824817a0dce67f3406a221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ea33ff-da71-4e40-8468-3430f07e49a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ea33ff-da71-4e40-8468-3430f07e49a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2ab31-897e-4468-9c63-6fea316c8f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2ab31-897e-4468-9c63-6fea316c8f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afab187-1b3a-4bd4-9f77-f04f4f244026', 'volume_name': 'volume-7afab187-1b3a-4bd4-9f77-f04f4f244026', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d227c00-0434-4c79-a34f-9661cc8840d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d227c00-0434-4c79-a34f-9661cc8840d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8655c150-1334-4343-b541-6be5a92d3014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Volume 7afab187-1b3a-4bd4-9f77-f04f4f244026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afab187-1b3a-4bd4-9f77-f04f4f244026', 'volume_size': 1} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1160378687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afab187-1b3a-4bd4-9f77-f04f4f244026,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='268f8a72d2ce4aa0bd63b732bf35d22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:27Z,use_quota=True,user_id='6c5d142fbf824817a0dce67f3406a221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Creating volume 7afab187-1b3a-4bd4-9f77-f04f4f244026 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:26 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:26 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 1073741824 Jul 23 03:25:26 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-quobyte-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:27 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 1073741824" returned: 0 in 0.677s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3440e375-639b-477d-b98f-bb38c646d779]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:27 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 Jul 23 03:25:27 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:27 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 Jul 23 03:25:27 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:28 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026" returned: 0 in 0.455s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8655c150-1334-4343-b541-6be5a92d3014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afab187-1b3a-4bd4-9f77-f04f4f244026', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4277c163-00b4-4f9d-8f80-3eb5a3d6113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Volume volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 (7afab187-1b3a-4bd4-9f77-f04f4f244026): created successfully Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4277c163-00b4-4f9d-8f80-3eb5a3d6113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Flow 'volume_create_manager' (dfa90656-19c3-476d-b06b-0ae800b0d51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-b03c89a6-8220-4ba4-8ab3-61ae293e9228 req-a955cd14-9f75-4332-9b98-6c873e933afb tempest-VolumesGetTestJSON-2127478715 None] Created volume successfully. Jul 23 03:25:28 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" returned: 0 in 0.726s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:28 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7 Jul 23 03:25:28 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:28 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" returned: 0 in 0.316s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7" released by "delete_volume" :: held 1.107s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Created reservations ['2723559a-57dc-453b-b5b8-28389b8d4edf', '67714297-fb1e-439e-ae14-f6b2f60b07a6', 'e89dd3f9-7ce6-4b42-88d2-3d1ef245d414', 'd269d589-bdc9-4c2a-a27f-f399dd497b1b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:28 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:28 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:29 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.421s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Deleted volume successfully. Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0530651b-96a6-4304-b625-a5520c1c8f46 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-b0dfa21e-9bc0-4d44-9af3-4ebb569b2ab7-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Acquiring lock "cinder-7afab187-1b3a-4bd4-9f77-f04f4f244026-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "cinder-7afab187-1b3a-4bd4-9f77-f04f4f244026-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:29 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (e3eb59ae-0d22-46f4-aa02-b1b791ab024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bc9df3-3968-4b24-b40c-3d2cc513bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Acquiring lock "cinder-quobyte-7afab187-1b3a-4bd4-9f77-f04f4f244026" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bc9df3-3968-4b24-b40c-3d2cc513bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100112877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f7d880-044d-47ba-aaec-27ccae00f96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:30Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75bbcac-7a72-414a-a455-dc67875755ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75bbcac-7a72-414a-a455-dc67875755ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199b3e79-2556-4b62-b603-cf2df78b1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199b3e79-2556-4b62-b603-cf2df78b1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f7d880-044d-47ba-aaec-27ccae00f96a', 'volume_name': 'volume-78f7d880-044d-47ba-aaec-27ccae00f96a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7468ae9-2cfc-433c-ba4d-b997c015ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7468ae9-2cfc-433c-ba4d-b997c015ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c613eff-ee73-454f-b530-b7f3c4646fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Volume 78f7d880-044d-47ba-aaec-27ccae00f96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f7d880-044d-47ba-aaec-27ccae00f96a', 'volume_size': 1} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100112877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f7d880-044d-47ba-aaec-27ccae00f96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:30Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Creating volume 78f7d880-044d-47ba-aaec-27ccae00f96a {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:30 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a 1073741824 Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "cinder-quobyte-7afab187-1b3a-4bd4-9f77-f04f4f244026" acquired by "delete_volume" :: waited 0.090s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:30 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2203e656-2bca-4155-8191-6e857b83503c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 Jul 23 03:25:30 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-06c826db-24e9-468d-8762-26921999307c tempest-GroupsTest-579310369 None] Group tempest-Group1-358145895: creating Jul 23 03:25:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-06c826db-24e9-468d-8762-26921999307c tempest-GroupsTest-579310369 None] Group tempest-Group1-358145895: created successfully Jul 23 03:25:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-06c826db-24e9-468d-8762-26921999307c tempest-GroupsTest-579310369 None] Create group completed successfully. Jul 23 03:25:30 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026 Jul 23 03:25:30 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a 1073741824" returned: 0 in 0.658s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a Jul 23 03:25:30 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7afab187-1b3a-4bd4-9f77-f04f4f244026" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "cinder-quobyte-7afab187-1b3a-4bd4-9f77-f04f4f244026" released by "delete_volume" :: held 0.889s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:31 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a" returned: 0 in 0.236s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c613eff-ee73-454f-b530-b7f3c4646fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f7d880-044d-47ba-aaec-27ccae00f96a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df6e8b0-328e-4179-a243-0a838e0a1f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Volume volume-78f7d880-044d-47ba-aaec-27ccae00f96a (78f7d880-044d-47ba-aaec-27ccae00f96a): created successfully Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df6e8b0-328e-4179-a243-0a838e0a1f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (e3eb59ae-0d22-46f4-aa02-b1b791ab024a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dde311bf-8d8f-41d5-b88d-3ca4202f04c6 tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.quota [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Created reservations ['562f3a0d-a490-4821-a8f4-4f85bad772d3', 'bf03ed0f-4ee5-46e7-bc89-6e801c66f760', '43eb9445-9618-42a7-96bf-8d348c66ffa8', '272585ca-1b2d-4894-8945-43ad7d26d33e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:31 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.manager [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Deleted volume successfully. Jul 23 03:25:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-ee72c79b-7f09-4c78-8a04-81ea109f4e96 req-93027ce8-b74e-42bb-85e1-cdd94c5d995e tempest-VolumesGetTestJSON-2127478715 None] Lock "cinder-7afab187-1b3a-4bd4-9f77-f04f4f244026-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-618a4a93-092c-4367-aa80-63fb1eb990c5 tempest-GroupsTest-579310369 None] Group tempest-Group2-1396585533: creating Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-618a4a93-092c-4367-aa80-63fb1eb990c5 tempest-GroupsTest-579310369 None] Group tempest-Group2-1396585533: created successfully Jul 23 03:25:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-618a4a93-092c-4367-aa80-63fb1eb990c5 tempest-GroupsTest-579310369 None] Create group completed successfully. Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-78f7d880-044d-47ba-aaec-27ccae00f96a-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-78f7d880-044d-47ba-aaec-27ccae00f96a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-quobyte-78f7d880-044d-47ba-aaec-27ccae00f96a" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-78f7d880-044d-47ba-aaec-27ccae00f96a" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ac5fcd-b724-4e7a-a514-8a729ab5d4b7]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:32 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a Jul 23 03:25:32 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:32 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a" returned: 0 in 0.472s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:32 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a Jul 23 03:25:32 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-quobyte-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:33 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-78f7d880-044d-47ba-aaec-27ccae00f96a" returned: 0 in 0.402s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-78f7d880-044d-47ba-aaec-27ccae00f96a" released by "delete_volume" :: held 0.957s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f429e005-8638-4ab1-a774-818f5c3d5e01]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Created reservations ['07a2a78f-ae21-4a40-9fce-37f408ab38c1', '397ba8a7-1369-4fd4-beba-3c4d8f63cdf4', 'f6060aa1-e54e-4b7f-9338-5f55141aec7c', 'd8fc7dd6-54ba-4235-8f05-417945aa5bdd'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:33 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 Jul 23 03:25:33 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:33 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (07a89872-c0e7-4c29-8c87-20ca71bf07da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43ae36-b642-43a9-b709-0234ef63b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43ae36-b642-43a9-b709-0234ef63b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295846004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=269fcc8f-0765-462f-b8b8-2b7fc939e192,host='devstack@QuobyteHD#QuobyteHD',id=15931ee4-0f0c-422c-bddd-63535ed06de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:33Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79c0c856-85d7-47a0-9fd2-3508f2920a12),volume_type_id=79c0c856-85d7-47a0-9fd2-3508f2920a12)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfd21c3-a53c-4440-97a9-0561d6a065d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfd21c3-a53c-4440-97a9-0561d6a065d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ddf7ae-9d93-45f8-b462-de3dbea1553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ddf7ae-9d93-45f8-b462-de3dbea1553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15931ee4-0f0c-422c-bddd-63535ed06de1', 'volume_name': 'volume-15931ee4-0f0c-422c-bddd-63535ed06de1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70626c5-963c-4067-b378-a68be612d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70626c5-963c-4067-b378-a68be612d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010d0a9-ed30-4a16-b026-c72059620070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Volume 15931ee4-0f0c-422c-bddd-63535ed06de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15931ee4-0f0c-422c-bddd-63535ed06de1', 'volume_size': 1} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=269fcc8f-0765-462f-b8b8-2b7fc939e192,created_at=2026-07-23T01:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295846004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=269fcc8f-0765-462f-b8b8-2b7fc939e192,host='devstack@QuobyteHD#QuobyteHD',id=15931ee4-0f0c-422c-bddd-63535ed06de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:33Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79c0c856-85d7-47a0-9fd2-3508f2920a12),volume_type_id=79c0c856-85d7-47a0-9fd2-3508f2920a12)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Creating volume 15931ee4-0f0c-422c-bddd-63535ed06de1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" returned: 0 in 0.552s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 1073741824 Jul 23 03:25:33 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3 Jul 23 03:25:33 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.446s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Deleted volume successfully. Jul 23 03:25:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40231921-adc8-45ff-adb0-298a5fa402b8 tempest-VolumesActionsTest-1723436090 None] Lock "cinder-78f7d880-044d-47ba-aaec-27ccae00f96a-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" returned: 0 in 0.394s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3" released by "delete_volume" :: held 1.011s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Created reservations ['13d762f1-a5c5-4a92-8816-50e592cb2488', '1df2c02f-d1c2-46a5-90ad-d02fcabe8232', '9c5df384-8865-49d4-8bea-1b92b9695c17', '3eb6b3eb-d97b-4550-9d76-2e38af715dd8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:34 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 1073741824" returned: 0 in 0.576s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:34 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 Jul 23 03:25:34 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Deleted volume successfully. Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e185f6b5-d249-42a8-8736-117052ab049d tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-d2bffed4-fa7d-4de4-bf12-f233d0a7d3f3-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1" returned: 0 in 0.336s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010d0a9-ed30-4a16-b026-c72059620070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15931ee4-0f0c-422c-bddd-63535ed06de1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d9cab-e818-45e0-b16f-eb3b71b6cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Volume volume-15931ee4-0f0c-422c-bddd-63535ed06de1 (15931ee4-0f0c-422c-bddd-63535ed06de1): created successfully Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d9cab-e818-45e0-b16f-eb3b71b6cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (07a89872-c0e7-4c29-8c87-20ca71bf07da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-87b7959b-9ed8-4621-bf55-b18efb5f61e4 tempest-GroupsTest-579310369 None] Created volume successfully. Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (6369a4b0-2520-4bd8-b3e2-d939bbf9b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8da141-b654-4998-9eff-4e00c2aaaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8da141-b654-4998-9eff-4e00c2aaaf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009338965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908291a1-72ea-46bd-bf43-8d999b150b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:35Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f21e3d-8240-4caa-9d75-e105921039e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f21e3d-8240-4caa-9d75-e105921039e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde311f-beb5-42e8-a4f2-8337f791ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde311f-beb5-42e8-a4f2-8337f791ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908291a1-72ea-46bd-bf43-8d999b150b85', 'volume_name': 'volume-908291a1-72ea-46bd-bf43-8d999b150b85', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d8e412-8ae1-4b34-815b-bb21c8a0bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d8e412-8ae1-4b34-815b-bb21c8a0bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11516e0d-c56c-4a86-8fe2-645ea111b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Volume 908291a1-72ea-46bd-bf43-8d999b150b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908291a1-72ea-46bd-bf43-8d999b150b85', 'volume_size': 1} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009338965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908291a1-72ea-46bd-bf43-8d999b150b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:35Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Creating volume 908291a1-72ea-46bd-bf43-8d999b150b85 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:35 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:35 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 1073741824 Jul 23 03:25:35 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-quobyte-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[114cdad8-7847-496f-bafa-c61580846195]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e Jul 23 03:25:35 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 1073741824" returned: 0 in 0.552s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:35 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 Jul 23 03:25:35 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" returned: 0 in 0.503s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e Jul 23 03:25:36 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 8 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:25:36 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85" returned: 0 in 0.434s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11516e0d-c56c-4a86-8fe2-645ea111b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908291a1-72ea-46bd-bf43-8d999b150b85', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cbc75f-178c-4481-8bad-700256e30683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" returned: 0 in 0.420s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e" released by "delete_volume" :: held 0.999s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:36 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Volume volume-908291a1-72ea-46bd-bf43-8d999b150b85 (908291a1-72ea-46bd-bf43-8d999b150b85): created successfully Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cbc75f-178c-4481-8bad-700256e30683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (6369a4b0-2520-4bd8-b3e2-d939bbf9b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b40779fd-2f61-4ea5-b6cd-ae274d285fe8 tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Created reservations ['9f8405a9-72d7-43b4-8484-621ff10a4cd7', '48608182-1f41-4414-9133-d681a95021a8', '445badc4-9574-42ce-a090-6385ed8eb766', 'f17d8dc7-bcdb-441d-b840-46b6262ed7dc'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:36 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Acquiring lock "cinder-quobyte-15931ee4-0f0c-422c-bddd-63535ed06de1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-15931ee4-0f0c-422c-bddd-63535ed06de1" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[23357441-3b66-4999-8100-2c4bcd900a11]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Deleted volume successfully. Jul 23 03:25:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98a5730b-3bc3-4915-84fc-0ab9d7e85a82 tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-5b4b1857-2f41-4aa8-a4a8-2a924c792a2e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:37 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 Jul 23 03:25:37 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1 Jul 23 03:25:37 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-908291a1-72ea-46bd-bf43-8d999b150b85-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "cinder-908291a1-72ea-46bd-bf43-8d999b150b85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=104,cinder:INSERT=21,cinder:UPDATE=118,cinder:DELETE=8 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-quobyte-908291a1-72ea-46bd-bf43-8d999b150b85" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-908291a1-72ea-46bd-bf43-8d999b150b85" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[24680145-247b-4ce3-a6fb-0105a591683f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15931ee4-0f0c-422c-bddd-63535ed06de1" returned: 0 in 0.342s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-15931ee4-0f0c-422c-bddd-63535ed06de1" released by "delete_volume" :: held 0.879s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Created reservations ['fed37022-dbd9-4cd1-963f-d98b86be3568'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:37 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 Jul 23 03:25:37 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-e8f296f1-bfb3-46f0-95db-cf98ac00af63-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88044]: WARNING cinder.quota [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-48376283 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-48376283, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:37 devstack cinder-volume[88044]: WARNING cinder.quota [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-48376283 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-48376283, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-e8f296f1-bfb3-46f0-95db-cf98ac00af63-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Created reservations ['cc7be395-583f-4f4a-8251-48dfa9abeb4f', '7abbb2a5-37b6-4c92-ae9d-0bf1179066a1', 'a423951d-d9f6-4ffe-884f-8a3f9d37d617', 'cd17efa3-bdff-40ba-b988-a19eed1f89a4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "cinder-quobyte-e8f296f1-bfb3-46f0-95db-cf98ac00af63" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-e8f296f1-bfb3-46f0-95db-cf98ac00af63" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-832f46ea-2c19-4a2b-98eb-9ec287f8778f tempest-GroupSnapshotsV319Test-1427687526 None] Group tempest-GroupSnapshotsV319Test-Group-112419035: creating Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c754a1-606c-49d6-880b-794e31edced4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-832f46ea-2c19-4a2b-98eb-9ec287f8778f tempest-GroupSnapshotsV319Test-1427687526 None] Group tempest-GroupSnapshotsV319Test-Group-112419035: created successfully Jul 23 03:25:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-832f46ea-2c19-4a2b-98eb-9ec287f8778f tempest-GroupSnapshotsV319Test-1427687526 None] Create group completed successfully. Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85" returned: 0 in 0.575s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:38 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 Jul 23 03:25:38 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85 Jul 23 03:25:38 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.290s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae3892b1-1adb-46df-8ff2-07ff6c71435e tempest-GroupsTest-579310369 None] Delete group completed successfully. Jul 23 03:25:38 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-908291a1-72ea-46bd-bf43-8d999b150b85" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-908291a1-72ea-46bd-bf43-8d999b150b85" released by "delete_volume" :: held 0.951s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:38 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63 Jul 23 03:25:38 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Created reservations ['27601269-bb41-42f4-a384-c3d724814dcf', '50843e0c-be32-42bf-9e58-b3311e4429fa', '3a55e41e-b055-4b68-9f3c-cefaacd290ab', 'dfb1d47d-28c2-40f2-a220-ec06132ab59a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:38 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e8f296f1-bfb3-46f0-95db-cf98ac00af63" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-quobyte-e8f296f1-bfb3-46f0-95db-cf98ac00af63" released by "delete_volume" :: held 0.806s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Created reservations ['027b665c-a1a1-4275-9b7d-972404d0b350', 'fa8168f2-7051-490b-b638-08783b34bd33', '11f3fff7-5043-4568-b141-53b24f599232', 'a7d4fc9b-73f4-4a50-969f-5dacd0374958'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.323s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Deleted volume successfully. Jul 23 03:25:39 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:39 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6a77dde-9701-43fd-a065-d6a0054d6e2e tempest-VolumesActionsTest-1723436090 None] Lock "cinder-908291a1-72ea-46bd-bf43-8d999b150b85-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Created reservations ['6abed0f5-0482-4384-b6c8-1ab6129af4be'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:39 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.423s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Deleted volume successfully. Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5515eb5f-5837-4478-978d-d621181be46f tempest-AttachVolumeTestJSON-1475294373 None] Lock "cinder-e8f296f1-bfb3-46f0-95db-cf98ac00af63-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:39 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3d0a26d0-98f2-4570-8e35-faf4fb629375 tempest-GroupsTest-579310369 None] Delete group completed successfully. Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Flow 'volume_create_manager' (0bb69707-dcbf-4c7c-a7eb-c120d7caf96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af64afb-2919-4ab3-b9e7-0102c1447ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af64afb-2919-4ab3-b9e7-0102c1447ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556712686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a85c03e-7726-4223-ba17-e6c23b9da055,host='devstack@QuobyteHD#QuobyteHD',id=d7b84700-a2ce-4228-8d5d-b735afc0a02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3ab5c8e01b4a4e84076e9e90bfd4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:40Z,use_quota=True,user_id='fdd1782f8db44a41a980e52bb41d48de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3971cf9e-ee46-4e12-9657-55af40e2532e),volume_type_id=3971cf9e-ee46-4e12-9657-55af40e2532e)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6df29d-8259-4372-874e-5a7853a65a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6df29d-8259-4372-874e-5a7853a65a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19995403-0f0d-44b5-a9b8-75b057ce398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19995403-0f0d-44b5-a9b8-75b057ce398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b84700-a2ce-4228-8d5d-b735afc0a02b', 'volume_name': 'volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ae8691-9ab3-49f2-8a87-3e55f943a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ae8691-9ab3-49f2-8a87-3e55f943a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d04931-6061-4022-9e33-193e3937c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Volume d7b84700-a2ce-4228-8d5d-b735afc0a02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b', 'volume_size': 1} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a85c03e-7726-4223-ba17-e6c23b9da055,created_at=2026-07-23T01:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556712686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a85c03e-7726-4223-ba17-e6c23b9da055,host='devstack@QuobyteHD#QuobyteHD',id=d7b84700-a2ce-4228-8d5d-b735afc0a02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3ab5c8e01b4a4e84076e9e90bfd4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:40Z,use_quota=True,user_id='fdd1782f8db44a41a980e52bb41d48de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3971cf9e-ee46-4e12-9657-55af40e2532e),volume_type_id=3971cf9e-ee46-4e12-9657-55af40e2532e)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Creating volume d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:40 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:40 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b 1073741824 Jul 23 03:25:40 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (7ac6f6f0-581b-40be-b918-4f65561c4747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87ba8d4-33f4-405c-bf00-03dd13d0da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b 1073741824" returned: 0 in 0.729s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87ba8d4-33f4-405c-bf00-03dd13d0da02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130248178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc75a79-196f-40cd-9b05-563262b94ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:41Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f5946-73bf-4585-ac75-bd85bcdaad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f5946-73bf-4585-ac75-bd85bcdaad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd1d67-261f-4d3d-8fe5-19422bb7b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd1d67-261f-4d3d-8fe5-19422bb7b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc75a79-196f-40cd-9b05-563262b94ee1', 'volume_name': 'volume-0bc75a79-196f-40cd-9b05-563262b94ee1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb0a175-75ee-4a66-8fd6-38e90a52ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb0a175-75ee-4a66-8fd6-38e90a52ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08c7912-e083-46ce-b4f5-5f1916af72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Volume 0bc75a79-196f-40cd-9b05-563262b94ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc75a79-196f-40cd-9b05-563262b94ee1', 'volume_size': 1} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:40 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b Jul 23 03:25:40 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a3fb4d82-6f6e-43ff-ade3-2f85ecc19f13 tempest-GroupsTest-579310369 None] Group tempest-GroupsTest-Group-979607737: creating Jul 23 03:25:41 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130248178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc75a79-196f-40cd-9b05-563262b94ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:41Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Creating volume 0bc75a79-196f-40cd-9b05-563262b94ee1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d04931-6061-4022-9e33-193e3937c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:41 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 1073741824 Jul 23 03:25:41 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4463c13-4ab4-4b09-b9fd-b84bf62e6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a3fb4d82-6f6e-43ff-ade3-2f85ecc19f13 tempest-GroupsTest-579310369 None] Group tempest-GroupsTest-Group-979607737: created successfully Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Volume volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b (d7b84700-a2ce-4228-8d5d-b735afc0a02b): created successfully Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4463c13-4ab4-4b09-b9fd-b84bf62e6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Flow 'volume_create_manager' (0bb69707-dcbf-4c7c-a7eb-c120d7caf96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a3fb4d82-6f6e-43ff-ade3-2f85ecc19f13 tempest-GroupsTest-579310369 None] Create group completed successfully. Jul 23 03:25:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b0a7a119-6f84-4e68-8e00-7b74d6d48ec8 tempest-GroupSnapshotsV319Test-1427687526 None] Created volume successfully. Jul 23 03:25:41 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 1073741824" returned: 0 in 0.513s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 Jul 23 03:25:41 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08c7912-e083-46ce-b4f5-5f1916af72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc75a79-196f-40cd-9b05-563262b94ee1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5b5ea7-c579-427f-920f-f3fd22d8d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:42 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Volume volume-0bc75a79-196f-40cd-9b05-563262b94ee1 (0bc75a79-196f-40cd-9b05-563262b94ee1): created successfully Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5b5ea7-c579-427f-920f-f3fd22d8d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (7ac6f6f0-581b-40be-b918-4f65561c4747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-848791b6-bdc7-4d54-8772-812850363472 tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] GroupSnapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: creating. Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Group snapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: creating. {{(pid=88044) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Creating offline snapshot b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 of volume d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01785c4-9774-4906-9756-547733617683]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b Jul 23 03:25:43 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (878d8a6f-0293-4ce6-8f7f-b7ab18175499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a2ad79-6654-4271-84a1-468c87f4c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a2ad79-6654-4271-84a1-468c87f4c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988617781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c5f861-c950-4cee-931f-0095e8759726,host='devstack@QuobyteHD#QuobyteHD',id=21fe39e8-b560-4878-ae23-828dd71518d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:43Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1110b800-a744-40f5-9c45-3ed3fba00619),volume_type_id=1110b800-a744-40f5-9c45-3ed3fba00619)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d1d15-7b26-4771-84ff-43f08ad217ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d1d15-7b26-4771-84ff-43f08ad217ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044e90e0-1214-4d8c-b6da-22e0e79a7f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044e90e0-1214-4d8c-b6da-22e0e79a7f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fe39e8-b560-4878-ae23-828dd71518d3', 'volume_name': 'volume-21fe39e8-b560-4878-ae23-828dd71518d3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242e58cc-d691-4f6a-b6f2-8b6871aefb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242e58cc-d691-4f6a-b6f2-8b6871aefb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67e1e83-eae3-4b73-a31e-fc971f7c723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Volume 21fe39e8-b560-4878-ae23-828dd71518d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fe39e8-b560-4878-ae23-828dd71518d3', 'volume_size': 1} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-0bc75a79-196f-40cd-9b05-563262b94ee1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "cinder-0bc75a79-196f-40cd-9b05-563262b94ee1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Acquiring lock "cinder-quobyte-0bc75a79-196f-40cd-9b05-563262b94ee1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-0bc75a79-196f-40cd-9b05-563262b94ee1" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c27eec-e1ec-450c-b586-89dcdc08fb2a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b" returned: 0 in 0.563s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 1G Jul 23 03:25:43 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 Jul 23 03:25:43 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1" returned: 0 in 0.474s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 1G" returned: 0 in 0.438s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1 Jul 23 03:25:43 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 Jul 23 03:25:43 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0bc75a79-196f-40cd-9b05-563262b94ee1" returned: 0 in 0.312s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "cinder-quobyte-0bc75a79-196f-40cd-9b05-563262b94ee1" released by "delete_volume" :: held 0.846s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 Jul 23 03:25:44 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Created reservations ['9e3d9612-5ad3-4b2c-8e49-7997ac97ec2e', '0b743a64-a1e5-4eeb-99e8-7cc5ceb03556', '9650169d-ba15-4731-85f7-f3e71291da2d', 'e5e408e9-3a05-4eac-8beb-c899239bab50'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:44 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" returned: 0 in 0.314s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info Jul 23 03:25:44 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Deleted volume successfully. Jul 23 03:25:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-98fd034e-6391-4a71-a35c-e9854115ef4c tempest-VolumesActionsTest-1723436090 None] Lock "cinder-0bc75a79-196f-40cd-9b05-563262b94ee1-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:45 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info" returned: 0 in 0.435s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info Jul 23 03:25:45 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (5515e98a-527f-449c-859a-f8685595b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcd142d-16e4-4694-860b-17886c01c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcd142d-16e4-4694-860b-17886c01c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161033387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065aa317-0667-42d0-9999-612b04d28b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:45Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c634d65-ed64-447c-adee-9960d6dd1848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c634d65-ed64-447c-adee-9960d6dd1848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccd7972-7eb8-4e88-ae1e-76d695918b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccd7972-7eb8-4e88-ae1e-76d695918b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065aa317-0667-42d0-9999-612b04d28b45', 'volume_name': 'volume-065aa317-0667-42d0-9999-612b04d28b45', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da648e0-fc95-499f-a9f3-b1075d50b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da648e0-fc95-499f-a9f3-b1075d50b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43a80b-9761-4611-a428-a9d49e6f3aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Volume 065aa317-0667-42d0-9999-612b04d28b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065aa317-0667-42d0-9999-612b04d28b45', 'volume_size': 1} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:45 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.info" returned: 0 in 0.276s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71c5f861-c950-4cee-931f-0095e8759726,created_at=2026-07-23T01:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988617781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c5f861-c950-4cee-931f-0095e8759726,host='devstack@QuobyteHD#QuobyteHD',id=21fe39e8-b560-4878-ae23-828dd71518d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:43Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1110b800-a744-40f5-9c45-3ed3fba00619),volume_type_id=1110b800-a744-40f5-9c45-3ed3fba00619)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Creating volume 21fe39e8-b560-4878-ae23-828dd71518d3 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:45 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 1073741824 Jul 23 03:25:45 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9cd7672f-a751-4425-bd7e-52d6313e2701 tempest-GroupSnapshotsV319Test-1427687526 None] group_snapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: created successfully Jul 23 03:25:45 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 1073741824" returned: 0 in 0.500s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 Jul 23 03:25:45 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:46 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3" returned: 0 in 0.294s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161033387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065aa317-0667-42d0-9999-612b04d28b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ceed148f494cc9b81a433e6c710cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:45Z,use_quota=True,user_id='8a8f881c3a6949009fd7642907597467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Creating volume 065aa317-0667-42d0-9999-612b04d28b45 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:46 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:46 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 1073741824 Jul 23 03:25:46 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67e1e83-eae3-4b73-a31e-fc971f7c723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fe39e8-b560-4878-ae23-828dd71518d3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af79635-82e4-4f41-b3f0-9da67330d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Volume volume-21fe39e8-b560-4878-ae23-828dd71518d3 (21fe39e8-b560-4878-ae23-828dd71518d3): created successfully Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af79635-82e4-4f41-b3f0-9da67330d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (878d8a6f-0293-4ce6-8f7f-b7ab18175499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-135148b7-3c8b-4b30-8453-f00cf9f2f190 tempest-GroupsTest-579310369 None] Created volume successfully. Jul 23 03:25:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] group_snapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: deleting Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] group_snapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: deleting {{(pid=88044) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "cinder-quobyte-b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Deleting offline snapshot b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 of volume d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] snapshot_file for this snap is: volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f6f55-c137-4762-9ca9-b1da1c717ede]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:46 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 1073741824" returned: 0 in 0.630s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:46 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 Jul 23 03:25:46 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:46 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 Jul 23 03:25:46 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:47 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" returned: 0 in 0.506s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:47 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40dad6e-9e0f-4586-9b6c-b30613e6a75f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43a80b-9761-4611-a428-a9d49e6f3aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065aa317-0667-42d0-9999-612b04d28b45', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf89c95-cf9a-4256-8cca-0729d9c19045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Volume volume-065aa317-0667-42d0-9999-612b04d28b45 (065aa317-0667-42d0-9999-612b04d28b45): created successfully Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf89c95-cf9a-4256-8cca-0729d9c19045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Flow 'volume_create_manager' (5515e98a-527f-449c-859a-f8685595b50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d5bb341a-976f-491e-b773-5793f53e7b44 tempest-VolumesActionsTest-2144446915 None] Created volume successfully. Jul 23 03:25:47 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b Jul 23 03:25:47 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (8af36759-0a8d-47c4-b532-2dd5b75f9267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d33c2d2-0106-4e80-ba12-d5826dbadde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b" returned: 0 in 0.511s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:47 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d33c2d2-0106-4e80-ba12-d5826dbadde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941900720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c5f861-c950-4cee-931f-0095e8759726,host='devstack@QuobyteHD#QuobyteHD',id=ef1e06f5-ed1a-4c60-997d-0ec6d6afd229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:48Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1110b800-a744-40f5-9c45-3ed3fba00619),volume_type_id=1110b800-a744-40f5-9c45-3ed3fba00619)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bb1c07-8d12-4121-8708-1b53e636d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bb1c07-8d12-4121-8708-1b53e636d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad35789-c1e6-43e3-805c-5d020213ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad35789-c1e6-43e3-805c-5d020213ac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1e06f5-ed1a-4c60-997d-0ec6d6afd229', 'volume_name': 'volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef71b2d-baef-4186-8f01-cb1d392811b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef71b2d-baef-4186-8f01-cb1d392811b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dbc505-20d1-4779-84fe-cecc4205ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Volume ef1e06f5-ed1a-4c60-997d-0ec6d6afd229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229', 'volume_size': 1} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71c5f861-c950-4cee-931f-0095e8759726,created_at=2026-07-23T01:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941900720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c5f861-c950-4cee-931f-0095e8759726,host='devstack@QuobyteHD#QuobyteHD',id=ef1e06f5-ed1a-4c60-997d-0ec6d6afd229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42468fd98b3045baad07cc88481967fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:48Z,use_quota=True,user_id='cf6b5405a3f8498381975320dbe826f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1110b800-a744-40f5-9c45-3ed3fba00619),volume_type_id=1110b800-a744-40f5-9c45-3ed3fba00619)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Creating volume ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:47 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:25:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:47 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 1073741824 Jul 23 03:25:47 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:48 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" returned: 0 in 0.458s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:48 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3 Jul 23 03:25:48 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:48 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 1073741824" returned: 0 in 0.588s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:48 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b.b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" returned: 0 in 0.301s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 Jul 23 03:25:48 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-b4b58d90-05d5-48bb-a1cb-376ae2a9faf3" released by "_delete_snapshot" :: held 1.946s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" released by "delete_snapshot" :: held 1.986s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:48 devstack cinder-volume[88044]: WARNING cinder.quota [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-501697253 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-501697253, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:48 devstack cinder-volume[88044]: WARNING cinder.quota [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-501697253 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-501697253, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] Created reservations ['9c567c34-822d-4157-a254-dd627f754ab0', '020ff8a0-2511-4c3a-b608-bc15096c8fc1', 'd7e57395-e312-45df-a301-d2c9c56ef481', '3ec7d99c-79a9-4a86-be4b-18373a73b59e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1bdbe424-6392-4b47-bcb7-b7f0561e91bc tempest-GroupSnapshotsV319Test-1427687526 None] group_snapshot 10ac50f6-9f35-4923-8d6b-a3895908c011: deleted successfully Jul 23 03:25:48 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" returned: 0 in 0.391s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dbc505-20d1-4779-84fe-cecc4205ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf74a6cf-0937-4271-bc48-094430f80594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Volume volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 (ef1e06f5-ed1a-4c60-997d-0ec6d6afd229): created successfully Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf74a6cf-0937-4271-bc48-094430f80594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Flow 'volume_create_manager' (8af36759-0a8d-47c4-b532-2dd5b75f9267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-53ea269b-d644-40ed-a1c2-29a9f6ec0741 tempest-GroupsTest-579310369 None] Created volume successfully. Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-065aa317-0667-42d0-9999-612b04d28b45-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "cinder-065aa317-0667-42d0-9999-612b04d28b45-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Acquiring lock "cinder-quobyte-065aa317-0667-42d0-9999-612b04d28b45" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "cinder-quobyte-065aa317-0667-42d0-9999-612b04d28b45" acquired by "delete_volume" :: waited 0.034s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c83a70-cde8-49df-bfe4-6d163a75ae64]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" acquired by "delete_volume" :: waited 0.038s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8754ab29-f8f0-4149-ad17-33d727162fb5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:49 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 Jul 23 03:25:49 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:49 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b Jul 23 03:25:49 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:49 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:49 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:49 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45 Jul 23 03:25:49 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:49 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b Jul 23 03:25:49 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d7b84700-a2ce-4228-8d5d-b735afc0a02b" returned: 0 in 0.314s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-065aa317-0667-42d0-9999-612b04d28b45" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "cinder-quobyte-d7b84700-a2ce-4228-8d5d-b735afc0a02b" released by "delete_volume" :: held 0.860s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "cinder-quobyte-065aa317-0667-42d0-9999-612b04d28b45" released by "delete_volume" :: held 0.946s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Created reservations ['a3dc2c48-8798-47dd-b63e-49a8e7fc2adf'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Created reservations ['2be548e0-0bd3-4c14-aacd-ffbab69d426c', 'f75761d9-53ab-4859-8983-18fb9d145c09', '638cfa0c-9f2a-4755-9cb4-1b8a1f189643', 'fc58a31a-3eea-4f7e-8030-16609f9429a4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-19686c8f-5e42-4c44-a0ec-28e7be5791d6 tempest-GroupsTest-579310369 None] Update group completed successfully. Jul 23 03:25:50 devstack cinder-volume[88044]: WARNING cinder.quota [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-501697253 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-501697253, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Created reservations ['33ada150-13aa-4a17-87bc-6c938470d825', 'e65fe951-881f-477c-8847-b286c180a2e1', '263fa036-0546-449d-915a-ee289417091d', '005ef21b-a918-4e4a-8b8b-22cffd002738'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:50 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:50 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Deleted volume successfully. Jul 23 03:25:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0460282e-f178-449b-9bd9-e5229d65a43c tempest-VolumesActionsTest-2144446915 None] Lock "cinder-065aa317-0667-42d0-9999-612b04d28b45-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:51 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1a2a9052-3bb1-44e1-ba9a-633d46ce2478 tempest-GroupSnapshotsV319Test-1427687526 None] Delete group completed successfully. Jul 23 03:25:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-66233816-4a27-4aa4-af75-c00f5c504fde tempest-GroupsTest-579310369 None] Update group completed successfully. Jul 23 03:25:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2c9d8b8f-b514-4e20-b538-3d45862fa6a3 tempest-GroupsV320Test-933946820 None] Group tempest-GroupsV320Test-Group-333982762: creating Jul 23 03:25:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2c9d8b8f-b514-4e20-b538-3d45862fa6a3 tempest-GroupsV320Test-933946820 None] Group tempest-GroupsV320Test-Group-333982762: created successfully Jul 23 03:25:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2c9d8b8f-b514-4e20-b538-3d45862fa6a3 tempest-GroupsV320Test-933946820 None] Create group completed successfully. Jul 23 03:25:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Acquiring lock "cinder-quobyte-21fe39e8-b560-4878-ae23-828dd71518d3" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-21fe39e8-b560-4878-ae23-828dd71518d3" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d64853c-360d-4a73-939b-5bb01844c18f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:54 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 Jul 23 03:25:54 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3" returned: 0 in 0.518s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:54 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3 Jul 23 03:25:54 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-21fe39e8-b560-4878-ae23-828dd71518d3" returned: 0 in 0.359s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-21fe39e8-b560-4878-ae23-828dd71518d3" released by "delete_volume" :: held 0.942s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Acquiring lock "cinder-quobyte-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad106855-3afc-466b-ba44-1355a1851a8d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:55 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 Jul 23 03:25:55 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:55 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" returned: 0 in 0.598s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:55 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229 Jul 23 03:25:55 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:55 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" returned: 0 in 0.319s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "cinder-quobyte-ef1e06f5-ed1a-4c60-997d-0ec6d6afd229" released by "delete_volume" :: held 0.994s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Created reservations ['c61ab5ae-0f00-4b77-919c-10c82194c05c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:56 devstack cinder-volume[88044]: WARNING cinder.quota [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1740166918 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1740166918, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:56 devstack cinder-volume[88044]: WARNING cinder.quota [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1740166918 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1740166918, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Created reservations ['0256ddc9-ad25-46d9-a018-03da06558e28', 'bd7a8ca8-1771-4e6a-b0c6-4c5d5881deb0', 'a2d417b6-5c82-46bf-8542-8b35adcd65f4', 'f735a457-b5f1-4586-8885-bc135e35e6e2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Created reservations ['0fcfd809-05a4-464c-ae2a-7febf7c620a7'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:56 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:56 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Created reservations ['58c58662-0dd2-4f81-9aae-d2623bb76d1a', 'fcf67512-3dad-4601-b0bd-b35b67fb47cb', 'e3514a61-ae28-4b89-9f01-f7e03c83198b', '15488282-62da-4590-844d-68fa12ddd22e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:56 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.463s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:56 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-aaf01990-8333-483d-a500-77c85a4c6a6c tempest-GroupsV320Test-933946820 None] Delete group completed successfully. Jul 23 03:25:56 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:25:56 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:57 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.342s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5f932107-7b5a-40a8-b952-fe366e1ec8b7 tempest-GroupsTest-579310369 None] Delete group completed successfully. Jul 23 03:26:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51270c5c-cd65-4792-ace6-91b5459ae13e tempest-GroupsV314Test-324428259 None] Group tempest-GroupsV314Test-Group-374135201: creating Jul 23 03:26:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51270c5c-cd65-4792-ace6-91b5459ae13e tempest-GroupsV314Test-324428259 None] Group tempest-GroupsV314Test-Group-374135201: created successfully Jul 23 03:26:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51270c5c-cd65-4792-ace6-91b5459ae13e tempest-GroupsV314Test-324428259 None] Create group completed successfully. Jul 23 03:26:01 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Flow 'volume_create_manager' (c7c340ed-5543-4800-88d0-a1c3844258d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021696d6-1131-4d26-8962-4d641b622902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021696d6-1131-4d26-8962-4d641b622902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-447877268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d92433a-5dc6-4ac8-80fc-9987206ae209,host='devstack@QuobyteHD#QuobyteHD',id=29e5bdfc-4d87-4553-9494-c45b62b9419d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1763ec413c0f402da479970a28879960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:02Z,use_quota=True,user_id='cded886fb5b043b4864893e158026fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce64720c-98f5-44b3-82c5-e32f73bb99b0),volume_type_id=ce64720c-98f5-44b3-82c5-e32f73bb99b0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0c8e8f-21a0-4661-9747-d703be7ccb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0c8e8f-21a0-4661-9747-d703be7ccb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a6571f-ff28-49dc-b690-6d9db43666eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a6571f-ff28-49dc-b690-6d9db43666eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e5bdfc-4d87-4553-9494-c45b62b9419d', 'volume_name': 'volume-29e5bdfc-4d87-4553-9494-c45b62b9419d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f344bb5-7402-49e6-a1ac-36da5068cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f344bb5-7402-49e6-a1ac-36da5068cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c977ba-5964-44c6-904a-d07465ce8341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Volume 29e5bdfc-4d87-4553-9494-c45b62b9419d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e5bdfc-4d87-4553-9494-c45b62b9419d', 'volume_size': 1} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d92433a-5dc6-4ac8-80fc-9987206ae209,created_at=2026-07-23T01:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-447877268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d92433a-5dc6-4ac8-80fc-9987206ae209,host='devstack@QuobyteHD#QuobyteHD',id=29e5bdfc-4d87-4553-9494-c45b62b9419d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1763ec413c0f402da479970a28879960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:02Z,use_quota=True,user_id='cded886fb5b043b4864893e158026fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce64720c-98f5-44b3-82c5-e32f73bb99b0),volume_type_id=ce64720c-98f5-44b3-82c5-e32f73bb99b0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Creating volume 29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:02 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:02 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d 1073741824 Jul 23 03:26:02 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:02 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d 1073741824" returned: 0 in 0.749s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:02 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:02 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:03 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c977ba-5964-44c6-904a-d07465ce8341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e5bdfc-4d87-4553-9494-c45b62b9419d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29da0e4b-9aa7-4c13-b529-f7b37c88d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:03 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Volume volume-29e5bdfc-4d87-4553-9494-c45b62b9419d (29e5bdfc-4d87-4553-9494-c45b62b9419d): created successfully Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29da0e4b-9aa7-4c13-b529-f7b37c88d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Flow 'volume_create_manager' (c7c340ed-5543-4800-88d0-a1c3844258d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-06c1903a-2321-4dd7-9420-a95be5af904d tempest-GroupsV314Test-324428259 None] Created volume successfully. Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=183,cinder:INSERT=51,cinder:UPDATE=204,cinder:DELETE=12 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:05 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Cloning volume 29e5bdfc-4d87-4553-9494-c45b62b9419d to volume c0a2a95b-577f-41cb-a5d7-729dfc73397e Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Creating offline snapshot b4650f12-9e03-4392-9799-222187653769 of volume 29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315e290-ab48-49bc-ab53-783c49cfbbc3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:05 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:05 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:05 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:05 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 1G Jul 23 03:26:05 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:06 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 1G" returned: 0 in 0.576s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e5bdfc-4d87-4553-9494-c45b62b9419d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:06 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e5bdfc-4d87-4553-9494-c45b62b9419d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:06 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:06 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e5bdfc-4d87-4553-9494-c45b62b9419d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.440s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:06 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:06 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:06 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:06 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Flow 'volume_create_manager' (47655fa8-0db1-4345-b33c-01adf27e9207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091063e4-c289-4a65-8dfd-cb19945c94b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091063e4-c289-4a65-8dfd-cb19945c94b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2131817737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bd313f-9ef3-41b1-969a-67ff6b1ce770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8eefbe6c5847ee937c785680e8d16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:07Z,use_quota=True,user_id='901e53885ff341dc84f3cff41a1fea27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753f320d-2154-4911-9d38-70b1f9eb0890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753f320d-2154-4911-9d38-70b1f9eb0890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338dc2d8-1de4-41dd-99d1-57d3634a079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338dc2d8-1de4-41dd-99d1-57d3634a079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bd313f-9ef3-41b1-969a-67ff6b1ce770', 'volume_name': 'volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438e42a-924c-40cd-930e-319cb6fcb158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438e42a-924c-40cd-930e-319cb6fcb158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9f712e-2f57-48f4-87fc-9b8b94df574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770', 'volume_size': 1} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:07 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:07 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info Jul 23 03:26:07 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:07 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info" returned: 0 in 0.308s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:07 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info Jul 23 03:26:07 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:07 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.info" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Acquiring lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] snapshot: b4650f12-9e03-4392-9799-222187653769, volume: c0a2a95b-577f-41cb-a5d7-729dfc73397e, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1980920-65e6-432e-bcb5-7b73bd77b064]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:08 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:08 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:08 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.416s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29e5bdfc-4d87-4553-9494-c45b62b9419d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190e85c-932b-46f7-8aca-536335c00006]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:08 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:08 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:08 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.448s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:26:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:08 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e Jul 23 03:26:08 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Flow 'volume_create_manager' (e5fe93a3-dc4a-4759-85ac-de9664c79815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37216f2e-5d4f-4d59-a3ca-f64f279b979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37216f2e-5d4f-4d59-a3ca-f64f279b979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-117204432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827fd7a1-9de8-4b02-aa91-4544ef63f06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c30c727b659478d820412f3809f48aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:14Z,use_quota=True,user_id='6385988a8cbd4ab5ac77f0dd60ca17d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7092ec3f-a2c5-42e7-b3cc-7f2d4ed2712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7092ec3f-a2c5-42e7-b3cc-7f2d4ed2712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ff35ae-fd1e-4916-b5b5-ae4cae5bace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:14 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e" returned: 0 in 6.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[621363c7-0577-4831-9f98-3507b28bab5b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:15 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:15 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:15 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.644s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:26:15 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Converted 1024.00 MB image at 160.71 MB/s Jul 23 03:26:15 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:26:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:15 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e Jul 23 03:26:15 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ff35ae-fd1e-4916-b5b5-ae4cae5bace9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '827fd7a1-9de8-4b02-aa91-4544ef63f06e', 'volume_name': 'volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3da38e-2787-4d59-887b-64fc5f2a6347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3da38e-2787-4d59-887b-64fc5f2a6347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119f3fca-331f-45a0-a520-0e839eedea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Trying to clone 827fd7a1-9de8-4b02-aa91-4544ef63f06e from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 at location (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:26:16 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e" returned: 0 in 0.396s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" released by "_copy_volume_from_snapshot" :: held 8.387s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Acquiring lock "cinder-quobyte-b4650f12-9e03-4392-9799-222187653769" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-b4650f12-9e03-4392-9799-222187653769" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Deleting offline snapshot b4650f12-9e03-4392-9799-222187653769 of volume 29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] snapshot_file for this snap is: volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b900eb-9a32-49fc-bb65-3af90f52c733]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:26:16 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:26:16 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e88465f-8e2f-4a9e-9df5-5bcbdfdcaeb1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:16 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:16 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD Jul 23 03:26:16 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:16 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.440s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29e5bdfc-4d87-4553-9494-c45b62b9419d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165a4b6-9858-4832-9324-bd7ae1aa07ed]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:17 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 is fetched for user 6385988a8cbd4ab5ac77f0dd60ca17d1. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:26:17 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:17 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7bad2-1045-43a2-9927-70f1c908830c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:17 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD Jul 23 03:26:17 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:17 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.432s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:17 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:17 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:17 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:17 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.350s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:17 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769 Jul 23 03:26:17 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d.b4650f12-9e03-4392-9799-222187653769" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-b4650f12-9e03-4392-9799-222187653769" released by "_delete_snapshot" :: held 1.601s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.802s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.991s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2131817737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bd313f-9ef3-41b1-969a-67ff6b1ce770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8eefbe6c5847ee937c785680e8d16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:07Z,use_quota=True,user_id='901e53885ff341dc84f3cff41a1fea27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Creating volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:18 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:18 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 1073741824 Jul 23 03:26:18 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-27a0b09d-4de0-4b68-8b36-5146086daeae tempest-GroupsV314Test-324428259 None] Create group from source-group-7d92433a-5dc6-4ac8-80fc-9987206ae209 completed successfully. Jul 23 03:26:18 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 1073741824" returned: 0 in 0.533s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:18 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 Jul 23 03:26:18 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770" returned: 0 in 0.257s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-117204432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827fd7a1-9de8-4b02-aa91-4544ef63f06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c30c727b659478d820412f3809f48aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:14Z,use_quota=True,user_id='6385988a8cbd4ab5ac77f0dd60ca17d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Creating volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:18 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9f712e-2f57-48f4-87fc-9b8b94df574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:18 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1073741824 Jul 23 03:26:18 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7b84e-777d-4217-9dec-16787a67597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:18 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Volume volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 (36bd313f-9ef3-41b1-969a-67ff6b1ce770): created successfully Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7b84e-777d-4217-9dec-16787a67597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Flow 'volume_create_manager' (47655fa8-0db1-4345-b33c-01adf27e9207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-398ad448-a3c6-4ce1-a740-cc771b802957 tempest-SnapshotsActionsTest-427657478 None] Created volume successfully. Jul 23 03:26:19 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1073741824" returned: 0 in 0.436s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:19 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e Jul 23 03:26:19 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Acquiring lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e34007-490c-4a89-aac4-95d6ab075e8a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:19 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e" returned: 0 in 0.328s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:19 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e Jul 23 03:26:19 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Attempting download of 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461eaea-d700-45f2-aef6-772d89cb2011]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:20 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns Jul 23 03:26:20 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Creating offline snapshot 077409c8-fa39-42ed-b219-231c2ee70416 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c479849e-ec25-437d-ab97-eb61e5970fcf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e" returned: 0 in 0.519s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e Jul 23 03:26:20 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 Jul 23 03:26:20 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns" returned: 0 in 0.405s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns Jul 23 03:26:20 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0a2a95b-577f-41cb-a5d7-729dfc73397e" returned: 0 in 0.321s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-c0a2a95b-577f-41cb-a5d7-729dfc73397e" released by "delete_volume" :: held 0.904s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:20 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770" returned: 0 in 0.497s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 1G Jul 23 03:26:20 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Created reservations ['cad7d7dd-1adc-4490-84b6-e7b6337ebba7'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:20 devstack cinder-volume[88044]: WARNING cinder.quota [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1562792535 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1562792535, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:26:20 devstack cinder-volume[88044]: WARNING cinder.quota [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1562792535 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1562792535, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:26:20 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns" returned: 1 in 0.416s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_7r1_l1ns' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2347939-2162-4cce-9e57-841b0f7535ba]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Created reservations ['f0382e69-f0bf-43e9-be69-c9ab3a5a0f4b', '9933d8bc-bdb1-4e77-81ea-70072a920a80', '6015ba85-27e2-46af-b8a9-15551f9a54b2', '00d84abc-194a-4683-9346-caea8057945d'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:20 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD Jul 23 03:26:20 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:20 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 1G" returned: 0 in 0.595s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:21 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] 305f1036-a296-4b7a-ad9a-5bff6ecc6243 was qcow2, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:21 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:21 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e Jul 23 03:26:21 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.309s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3525c518-e4cd-43cf-96db-22eaf1d25a39 tempest-GroupsV314Test-324428259 None] Delete group completed successfully. Jul 23 03:26:21 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 is being set with open permissions: ugo+rw Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:21 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:21 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:21 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info Jul 23 03:26:21 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:22 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info" returned: 0 in 0.368s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:22 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info is being set with open permissions: ugo+rw Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:22 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info Jul 23 03:26:22 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Acquiring lock "cinder-quobyte-29e5bdfc-4d87-4553-9494-c45b62b9419d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-29e5bdfc-4d87-4553-9494-c45b62b9419d" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb27c884-8ab6-4cec-8606-488f981d9aa0]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:22 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:22 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:22 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.info" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-03d1bcd2-5854-4a1b-8152-437563de2176 tempest-SnapshotsActionsTest-427657478 None] Create snapshot completed successfully Jul 23 03:26:22 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.465s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:22 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d Jul 23 03:26:22 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:23 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-29e5bdfc-4d87-4553-9494-c45b62b9419d" returned: 0 in 0.328s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Lock "cinder-quobyte-29e5bdfc-4d87-4553-9494-c45b62b9419d" released by "delete_volume" :: held 0.915s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:23 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e" returned: 0 in 2.194s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_gaia0ft7devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:26:23 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Converted 112.00 MB image at 51.00 MB/s Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Created reservations ['5ed12638-adf0-4e22-9dd6-477a8c93e940'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:23 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1G Jul 23 03:26:23 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Created reservations ['a1aff37c-1ec5-4582-8d11-4b6bddb35623', 'f68194b9-ec77-4c30-b170-e81ca4d6ff97', 'f08b24bd-6fd1-49f2-a0bb-167b453e5e5d', 'eb5121d0-8188-47c8-b5b7-9defd9bd3322'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:23 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:23 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:23 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e 1G" returned: 0 in 0.531s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Downloaded image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 for user 6385988a8cbd4ab5ac77f0dd60ca17d1 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Marking volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:26:23 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Copying metadata from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 to 827fd7a1-9de8-4b02-aa91-4544ef63f06e. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:26:23 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Creating volume glance metadata for volume 827fd7a1-9de8-4b02-aa91-4544ef63f06e backed by image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:26:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-73d74e72-5da2-4cee-8285-33bf98a96a5e tempest-GroupsV314Test-324428259 None] Delete group completed successfully. Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Creating offline snapshot f6658394-70c3-4734-a5bb-006135a12fc0 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[370137ca-b57a-4a4a-b0d2-d0e2428044f6]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119f3fca-331f-45a0-a520-0e839eedea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518292c-406f-44f8-a5fe-87b48d0b1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:24 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Volume volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e (827fd7a1-9de8-4b02-aa91-4544ef63f06e): created successfully Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518292c-406f-44f8-a5fe-87b48d0b1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Flow 'volume_create_manager' (e5fe93a3-dc4a-4759-85ac-de9664c79815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d40223bd-d464-451e-8197-2b7819371236 tempest-VolumesImageMetadata-437584458 None] Created volume successfully. Jul 23 03:26:24 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:24 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:24 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:24 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 1G Jul 23 03:26:24 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:25 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 1G" returned: 0 in 0.627s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:25 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 Jul 23 03:26:25 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:25 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0" returned: 0 in 0.451s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:25 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 is being set with open permissions: ugo+rw Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Acquiring lock "cinder-827fd7a1-9de8-4b02-aa91-4544ef63f06e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "cinder-827fd7a1-9de8-4b02-aa91-4544ef63f06e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:25 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 Jul 23 03:26:25 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Acquiring lock "cinder-quobyte-827fd7a1-9de8-4b02-aa91-4544ef63f06e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "cinder-quobyte-827fd7a1-9de8-4b02-aa91-4544ef63f06e" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[92266064-0ae4-4b92-a7b7-80a9f2c68478]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:26 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e Jul 23 03:26:26 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:26 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0" returned: 0 in 0.424s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-44abf8e6-1b69-4860-bf06-ae9ccff7f7aa tempest-SnapshotsActionsTest-427657478 None] Create snapshot completed successfully Jul 23 03:26:26 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:26 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e Jul 23 03:26:26 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:26 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-827fd7a1-9de8-4b02-aa91-4544ef63f06e" returned: 0 in 0.301s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "cinder-quobyte-827fd7a1-9de8-4b02-aa91-4544ef63f06e" released by "delete_volume" :: held 0.921s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Created reservations ['ac153a0d-b789-4b0c-a8d2-1e3ec27bc314', '107a1040-59aa-484d-8643-f57b347806bf', 'ed0d0a74-42c1-4a7a-8ce8-aa21d03343f5', 'b0eef52e-007c-43d6-8770-57612af8a9de'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:26 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:26 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:27 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Deleted volume successfully. Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-200fb959-506d-4c37-9a21-9e5a8e322579 tempest-VolumesImageMetadata-437584458 None] Lock "cinder-827fd7a1-9de8-4b02-aa91-4544ef63f06e-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-f6658394-70c3-4734-a5bb-006135a12fc0-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-f6658394-70c3-4734-a5bb-006135a12fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-f6658394-70c3-4734-a5bb-006135a12fc0" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-f6658394-70c3-4734-a5bb-006135a12fc0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Deleting offline snapshot f6658394-70c3-4734-a5bb-006135a12fc0 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] snapshot_file for this snap is: volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ca8842-d57e-4954-bbc1-630f9cf83a73]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:27 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 Jul 23 03:26:27 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:27 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[605107ec-00b0-4d5b-8c2e-20efe4baf1d4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:28 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:28 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:28 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:28 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 Jul 23 03:26:28 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:28 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0" returned: 0 in 0.450s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:28 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0 Jul 23 03:26:28 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:29 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.f6658394-70c3-4734-a5bb-006135a12fc0" returned: 0 in 0.327s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-f6658394-70c3-4734-a5bb-006135a12fc0" released by "_delete_snapshot" :: held 1.698s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_snapshot" :: held 1.730s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:29 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Created reservations ['1e20777b-9f37-40a5-ad36-f8d9e897d288', '1472f3b9-547f-41fe-80ad-cc57e56a1014', '23caca13-58cd-4f80-acd3-d1e177c5fc64', '70412ab0-28a2-454c-bf5e-0a06f866be2f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Delete snapshot completed successfully. Jul 23 03:26:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4008ad1-9c9e-4d45-a9e0-e524da655bba tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-f6658394-70c3-4734-a5bb-006135a12fc0-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Creating offline snapshot 45e754a8-c80e-45f9-abea-e7836b068460 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1171853-ad1b-43f0-a215-34646742cc5e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:30 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:30 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:30 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.460s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:30 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 1G Jul 23 03:26:30 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:31 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Flow 'volume_create_manager' (0f661cca-07dc-495c-80cd-fad2ae2ccad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204e1df8-72b2-413e-8249-609f3254ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 1G" returned: 0 in 0.691s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204e1df8-72b2-413e-8249-609f3254ad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-726013410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a28dd1a-4616-4093-9d6d-1c12d906be18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63613dddb644cfc941053e66e516400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:31Z,use_quota=True,user_id='be663d2a0d604247b30df93fb44fce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ccad66-fc34-4095-bf71-3a99ac98601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 Jul 23 03:26:31 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ccad66-fc34-4095-bf71-3a99ac98601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ebea7a-908d-43da-b5d1-f156de5b994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ebea7a-908d-43da-b5d1-f156de5b994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a28dd1a-4616-4093-9d6d-1c12d906be18', 'volume_name': 'volume-6a28dd1a-4616-4093-9d6d-1c12d906be18', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766d2a8f-0e7c-4a65-a9f4-2b9f513e6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766d2a8f-0e7c-4a65-a9f4-2b9f513e6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9d114f-095c-4dc2-9ca3-bf42ade229b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Volume 6a28dd1a-4616-4093-9d6d-1c12d906be18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a28dd1a-4616-4093-9d6d-1c12d906be18', 'volume_size': 1} Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:31 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:31 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 is being set with open permissions: ugo+rw Jul 23 03:26:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:31 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 Jul 23 03:26:31 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-726013410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a28dd1a-4616-4093-9d6d-1c12d906be18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63613dddb644cfc941053e66e516400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:31Z,use_quota=True,user_id='be663d2a0d604247b30df93fb44fce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Creating volume 6a28dd1a-4616-4093-9d6d-1c12d906be18 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:32 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6957ff24-9cb9-4770-a439-115b24f82aef tempest-SnapshotsActionsTest-427657478 None] Create snapshot completed successfully Jul 23 03:26:32 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 1073741824 Jul 23 03:26:32 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Flow 'volume_create_manager' (6e70a3ff-ef7f-411c-ab24-258567c93358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78b679-2448-4ce8-b6be-cb448cb99a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78b679-2448-4ce8-b6be-cb448cb99a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1260501964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbc8881-6e4f-42d1-85e8-088a5c532f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76f5c38342f458ebc22ef5794068962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:32Z,use_quota=True,user_id='3739df59873547c8b0215ff0764de129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae53fe98-0bd0-43fa-a36a-21229a70d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae53fe98-0bd0-43fa-a36a-21229a70d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481dfe1c-bb80-41e5-81c5-43e7fe0a7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481dfe1c-bb80-41e5-81c5-43e7fe0a7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbc8881-6e4f-42d1-85e8-088a5c532f9d', 'volume_name': 'volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f2aa43-cb32-4da3-878d-a1e57f34636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f2aa43-cb32-4da3-878d-a1e57f34636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fddeb1-e4fe-48ff-81dd-5b677cd109e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Volume ecbc8881-6e4f-42d1-85e8-088a5c532f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d', 'volume_size': 1} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:32 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 1073741824" returned: 0 in 0.538s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:32 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 Jul 23 03:26:32 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1260501964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbc8881-6e4f-42d1-85e8-088a5c532f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76f5c38342f458ebc22ef5794068962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:32Z,use_quota=True,user_id='3739df59873547c8b0215ff0764de129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Creating volume ecbc8881-6e4f-42d1-85e8-088a5c532f9d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9d114f-095c-4dc2-9ca3-bf42ade229b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a28dd1a-4616-4093-9d6d-1c12d906be18', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:33 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d 1073741824 Jul 23 03:26:33 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42b62c4-ae2a-46b6-81d2-8108db9013e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Volume volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 (6a28dd1a-4616-4093-9d6d-1c12d906be18): created successfully Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42b62c4-ae2a-46b6-81d2-8108db9013e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Flow 'volume_create_manager' (0f661cca-07dc-495c-80cd-fad2ae2ccad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ab68146e-8474-4d3e-93bc-4a82247f75b6 tempest-VolumesServicesTestJSON-1657226384 None] Created volume successfully. Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-45e754a8-c80e-45f9-abea-e7836b068460-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-45e754a8-c80e-45f9-abea-e7836b068460-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-45e754a8-c80e-45f9-abea-e7836b068460" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-45e754a8-c80e-45f9-abea-e7836b068460" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Deleting offline snapshot 45e754a8-c80e-45f9-abea-e7836b068460 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] snapshot_file for this snap is: volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Acquiring lock "cinder-6a28dd1a-4616-4093-9d6d-1c12d906be18-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7226907e-5110-445a-bd6b-282929c2c3bf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "cinder-6a28dd1a-4616-4093-9d6d-1c12d906be18-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Acquiring lock "cinder-quobyte-6a28dd1a-4616-4093-9d6d-1c12d906be18" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "cinder-quobyte-6a28dd1a-4616-4093-9d6d-1c12d906be18" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:33 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979dc58-c2b1-471d-a1a1-131b28fc7767]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:33 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 Jul 23 03:26:33 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d 1073741824" returned: 0 in 0.697s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:33 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d Jul 23 03:26:33 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 Jul 23 03:26:33 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460" returned: 0 in 0.442s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[191f884e-0126-4651-82f1-0d6ebcf9e5ce]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:34 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" returned: 0 in 0.418s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:34 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:34 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fddeb1-e4fe-48ff-81dd-5b677cd109e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd22e8f-06db-425b-acd4-cb2cc55f5235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18" returned: 0 in 0.561s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Volume volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d (ecbc8881-6e4f-42d1-85e8-088a5c532f9d): created successfully Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd22e8f-06db-425b-acd4-cb2cc55f5235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Flow 'volume_create_manager' (6e70a3ff-ef7f-411c-ab24-258567c93358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:34 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18 Jul 23 03:26:34 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-55e78712-7fcd-40bc-8bd6-355436581312 tempest-VolumesMetadataTest-1777918909 None] Created volume successfully. Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.621s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:34 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:34 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 Jul 23 03:26:34 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:34 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6a28dd1a-4616-4093-9d6d-1c12d906be18" returned: 0 in 0.522s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "cinder-quobyte-6a28dd1a-4616-4093-9d6d-1c12d906be18" released by "delete_volume" :: held 1.132s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Created reservations ['b711a650-baff-42a8-ae8c-308179c7919c', '5389035b-f5b0-4c41-b9bc-cea94f9224f0', '4abe6cb3-b990-4bac-9aff-74a7e5f0da4d', '432c7db1-2c88-4362-a60b-bc3fef26ced4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:35 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:35 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:35 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460" returned: 0 in 0.584s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:35 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460 Jul 23 03:26:35 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:35 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.402s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Deleted volume successfully. Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-257f3121-97d1-4f67-9484-b6f68e79098b tempest-VolumesServicesTestJSON-1657226384 None] Lock "cinder-6a28dd1a-4616-4093-9d6d-1c12d906be18-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Acquiring lock "cinder-ecbc8881-6e4f-42d1-85e8-088a5c532f9d-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "cinder-ecbc8881-6e4f-42d1-85e8-088a5c532f9d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Acquiring lock "cinder-quobyte-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "cinder-quobyte-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b25188a-8be8-4d05-84ba-b0cf23e995cf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:35 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.45e754a8-c80e-45f9-abea-e7836b068460" returned: 0 in 0.411s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-45e754a8-c80e-45f9-abea-e7836b068460" released by "_delete_snapshot" :: held 2.203s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_snapshot" :: held 2.244s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:35 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d Jul 23 03:26:35 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Created reservations ['278d3a8e-cd45-48cc-b5cd-4c8442cd5d35', 'e1558806-8b15-419e-a69f-f5bb451d6eb5', 'cc1f38f2-c2ff-4066-a7d9-3112060eb264', '4884f5c6-e714-4d7f-805b-34fb7fdacbf9'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:35 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:35 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Delete snapshot completed successfully. Jul 23 03:26:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-304cadc5-59d6-4784-9c60-3197a208bc35 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-45e754a8-c80e-45f9-abea-e7836b068460-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:36 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" returned: 0 in 0.576s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:36 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:26:36 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:26:36 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:36 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "cinder-quobyte-ecbc8881-6e4f-42d1-85e8-088a5c532f9d" released by "delete_volume" :: held 0.930s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Created reservations ['b9d79db7-2326-4f9c-9bda-c363acd38ab4', 'a81b7648-eb73-4704-bd2b-b367bf0a7489', 'bc106fc5-1034-4060-9a3b-499106aaac03', 'fb8d09c5-23c6-423a-92db-dc7e5c690e72'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:36 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:36 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:37 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.382s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Deleted volume successfully. Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-818e284d-e958-40bb-af9e-7bca25639075 tempest-VolumesMetadataTest-1777918909 None] Lock "cinder-ecbc8881-6e4f-42d1-85e8-088a5c532f9d-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Creating offline snapshot 92eb05b1-91b3-4e1f-9239-0d31838618ea of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[28776db8-0b1b-4162-a6c9-41df6ca22694]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:37 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:37 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:37 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.418s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:37 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea 1G Jul 23 03:26:37 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:38 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea 1G" returned: 0 in 0.692s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:38 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea Jul 23 03:26:38 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:38 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea" returned: 0 in 0.412s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea is being set with open permissions: ugo+rw Jul 23 03:26:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:39 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea Jul 23 03:26:39 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:39 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea" returned: 0 in 0.411s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:39 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=194,cinder:SELECT=173,cinder:INSERT=51,cinder:DELETE=14 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d8409c78-1389-4eaa-8928-9718f0911465 tempest-SnapshotsActionsTest-427657478 None] Create snapshot completed successfully Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-92eb05b1-91b3-4e1f-9239-0d31838618ea-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-92eb05b1-91b3-4e1f-9239-0d31838618ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-92eb05b1-91b3-4e1f-9239-0d31838618ea" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-92eb05b1-91b3-4e1f-9239-0d31838618ea" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Deleting offline snapshot 92eb05b1-91b3-4e1f-9239-0d31838618ea of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] snapshot_file for this snap is: volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef3a85-73a4-4521-ac96-fb98da31190f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:40 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea Jul 23 03:26:40 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:41 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea" returned: 0 in 0.433s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[382144aa-3ecc-49d7-8a14-f1ff9509c0fb]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:41 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:41 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:41 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.517s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:41 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea Jul 23 03:26:41 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:42 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea" returned: 0 in 0.551s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:42 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea Jul 23 03:26:42 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:42 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.92eb05b1-91b3-4e1f-9239-0d31838618ea" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-92eb05b1-91b3-4e1f-9239-0d31838618ea" released by "_delete_snapshot" :: held 1.971s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_snapshot" :: held 2.004s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Created reservations ['15dbaae1-ba16-481d-a68d-bd9d180236f5', 'c365426c-cf7f-4c83-8db6-7bc93e9c7550', 'e3517825-29ec-45e4-9f54-77057159a8df', '821a32f0-a823-4f6f-b4c8-946eb60a22c1'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Delete snapshot completed successfully. Jul 23 03:26:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f4d95c6-4deb-4516-90a5-72b1d05a7bf3 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-92eb05b1-91b3-4e1f-9239-0d31838618ea-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Creating offline snapshot 9cfb24a0-a8d5-42af-842a-a5e373deb0fe of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:44 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d3c26-7b06-44a5-83ac-5021ad3a809a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:44 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:44 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:45 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.602s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe 1G Jul 23 03:26:45 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Flow 'volume_create_manager' (59b4756d-391b-42f7-b7b0-c4fd0666712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e3aedf-5769-40fd-80ce-5dc4f55d514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e3aedf-5769-40fd-80ce-5dc4f55d514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1735946168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450b81b9910b433b90cca0140c04eed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:45Z,use_quota=True,user_id='776816984bb44286aa86ba6ebf630403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8c293f-d144-4eec-8ca7-0c30ca7a0b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8c293f-d144-4eec-8ca7-0c30ca7a0b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b85ab8-f34d-43bc-b992-cd1bc2b9c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b85ab8-f34d-43bc-b992-cd1bc2b9c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0', 'volume_name': 'volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b78b22-f462-4220-9222-319693fcd75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b78b22-f462-4220-9222-319693fcd75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8c5784-7c21-4c02-9925-4de0369490df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Volume 2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0', 'volume_size': 1} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:45 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe 1G" returned: 0 in 0.555s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe Jul 23 03:26:45 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe" returned: 0 in 0.349s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe is being set with open permissions: ugo+rw Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe Jul 23 03:26:46 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe" returned: 0 in 0.270s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1735946168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450b81b9910b433b90cca0140c04eed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:45Z,use_quota=True,user_id='776816984bb44286aa86ba6ebf630403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Creating volume 2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:46 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 1073741824 Jul 23 03:26:46 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b3f47e58-3a05-4edb-af2e-cf2ac1a8c0d7 tempest-SnapshotsActionsTest-427657478 None] Create snapshot completed successfully Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-9cfb24a0-a8d5-42af-842a-a5e373deb0fe-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-9cfb24a0-a8d5-42af-842a-a5e373deb0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Acquiring lock "cinder-quobyte-9cfb24a0-a8d5-42af-842a-a5e373deb0fe" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-9cfb24a0-a8d5-42af-842a-a5e373deb0fe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Deleting offline snapshot 9cfb24a0-a8d5-42af-842a-a5e373deb0fe of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] snapshot_file for this snap is: volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32b0ec-79b3-403a-801a-e7995b4a4f3b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe Jul 23 03:26:47 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 1073741824" returned: 0 in 0.733s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 Jul 23 03:26:47 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe" returned: 0 in 0.524s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9282fa3-e1d3-4b3e-92c1-505213ab7b56]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" returned: 0 in 0.341s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8c5784-7c21-4c02-9925-4de0369490df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538f034-480f-46ca-acde-8395a6762307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Volume volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 (2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0): created successfully Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538f034-480f-46ca-acde-8395a6762307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Flow 'volume_create_manager' (59b4756d-391b-42f7-b7b0-c4fd0666712a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:47 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:47 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-afe7be60-0981-49f5-81d6-759e6c327189 tempest-VolumesTransfersTest-1294347172 None] Created volume successfully. Jul 23 03:26:48 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.514s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe Jul 23 03:26:48 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Flow 'volume_create_manager' (684bec1d-cab0-43a0-b678-fd4724f47ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6140b79b-715c-4ecb-9acb-5b78a660c683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6140b79b-715c-4ecb-9acb-5b78a660c683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219559982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8160d6f0-a2f5-49ef-a152-521ecabbb774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646eb9f40f00401aa2e8f047c23911cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:48Z,use_quota=True,user_id='703291a6a34648f0a3016e8405563a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2931c1d-416b-4ba6-8e1f-bf70e622cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2931c1d-416b-4ba6-8e1f-bf70e622cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f3d5ab-70ab-4bc5-a900-bd3231764689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f3d5ab-70ab-4bc5-a900-bd3231764689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8160d6f0-a2f5-49ef-a152-521ecabbb774', 'volume_name': 'volume-8160d6f0-a2f5-49ef-a152-521ecabbb774', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f9c351-d6c9-47b9-93da-76554d007dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f9c351-d6c9-47b9-93da-76554d007dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ddea3b-d118-40c9-a9e2-6ee342899a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Volume 8160d6f0-a2f5-49ef-a152-521ecabbb774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8160d6f0-a2f5-49ef-a152-521ecabbb774', 'volume_size': 1} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219559982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8160d6f0-a2f5-49ef-a152-521ecabbb774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646eb9f40f00401aa2e8f047c23911cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:48Z,use_quota=True,user_id='703291a6a34648f0a3016e8405563a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Creating volume 8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:48 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 1073741824 Jul 23 03:26:48 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe" returned: 0 in 0.583s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe Jul 23 03:26:48 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 1073741824" returned: 0 in 0.623s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.9cfb24a0-a8d5-42af-842a-a5e373deb0fe" returned: 0 in 0.386s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-9cfb24a0-a8d5-42af-842a-a5e373deb0fe" released by "_delete_snapshot" :: held 2.154s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_snapshot" :: held 2.186s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 Jul 23 03:26:49 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Created reservations ['4f924468-66e3-4e02-8d58-f6519d847d1e', '98ec40c8-875d-4a83-ae1a-b82b1b33a84b', '54da4f33-50e0-41ca-9c90-6134557b9232', 'b1efd6cc-5b9c-47ad-af9c-8549754bb86e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Delete snapshot completed successfully. Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a9a5dd4e-eae0-40f5-ad1b-3a9197fba6d2 tempest-SnapshotsActionsTest-1470544411 None] Lock "cinder-9cfb24a0-a8d5-42af-842a-a5e373deb0fe-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:49 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774" returned: 0 in 0.319s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ddea3b-d118-40c9-a9e2-6ee342899a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8160d6f0-a2f5-49ef-a152-521ecabbb774', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4260917-4c88-4cb5-8b2b-930f767e5aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Volume volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 (8160d6f0-a2f5-49ef-a152-521ecabbb774): created successfully Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4260917-4c88-4cb5-8b2b-930f767e5aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Flow 'volume_create_manager' (684bec1d-cab0-43a0-b678-fd4724f47ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8ad5ed2a-1fa3-4a0e-9c06-2f84c32da650 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Created volume successfully. Jul 23 03:26:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1e219e73-33b7-47f4-9321-2cc542f57004 tempest-VolumesTransfersTest-2102374177 None] Transfer volume completed successfully. Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "cinder-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "cinder-quobyte-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-quobyte-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0285d-8a1d-4eeb-8255-8202728eba45]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:50 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 Jul 23 03:26:50 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Creating offline snapshot 78d5227e-c6c4-443e-9f8b-abac80a7c55b of volume 8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67aee01-0a71-4824-b24f-f730cc6e67a3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "cinder-077409c8-fa39-42ed-b219-231c2ee70416-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-077409c8-fa39-42ed-b219-231c2ee70416-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "cinder-quobyte-077409c8-fa39-42ed-b219-231c2ee70416" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-077409c8-fa39-42ed-b219-231c2ee70416" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Deleting offline snapshot 077409c8-fa39-42ed-b219-231c2ee70416 of volume 36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:50 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 Jul 23 03:26:50 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] snapshot_file for this snap is: volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[18caaea3-baef-4d79-8b01-50cb72a92c30]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0 Jul 23 03:26:51 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:51 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774" returned: 0 in 0.614s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-quobyte-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0" released by "delete_volume" :: held 0.980s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:51 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b 1G Jul 23 03:26:51 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (57160b24-2d4f-4c0a-bd35-5262c15c61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7416e0-5923-4c5d-98dc-1937f856ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7416e0-5923-4c5d-98dc-1937f856ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-697481889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145297c5-fe9d-443b-a4ce-530f7596b83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b316ed6b5598437d89494c018ac26135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:51Z,use_quota=True,user_id='f2fcb181852c4df398504da759b67ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe23c0e-8def-4f61-94a7-5cf1423a0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe23c0e-8def-4f61-94a7-5cf1423a0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9885f071-145f-4731-b906-231be77a1669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9885f071-145f-4731-b906-231be77a1669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145297c5-fe9d-443b-a4ce-530f7596b83e', 'volume_name': 'volume-145297c5-fe9d-443b-a4ce-530f7596b83e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518247cf-d956-41ce-b846-fb0737b4027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518247cf-d956-41ce-b846-fb0737b4027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee179a16-d375-46ee-8bc3-f289e4b45a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Volume 145297c5-fe9d-443b-a4ce-530f7596b83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145297c5-fe9d-443b-a4ce-530f7596b83e', 'volume_size': 1} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:51 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.489s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7b5d15-a8c6-43f5-b7da-7a962ab28f81]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Created reservations ['bc374197-88c3-409d-9ab9-1bec3b0482e0', '2da14600-9f0f-4b51-ab94-45217cbf0ed3', '3fc5aaea-d9d7-48b2-9e48-42673eef32c5', '9c1e6d54-8501-4940-8f8d-2bb8fa0e3efc'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 Jul 23 03:26:51 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:51 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b 1G" returned: 0 in 0.518s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b Jul 23 03:26:51 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:51 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Deleted volume successfully. Jul 23 03:26:51 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770" returned: 0 in 0.453s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f28a5c80-49a6-4820-90b2-e5b360ee2395 tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-2eb45ca4-a9fb-4da3-ae9c-a67ca67b77e0-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:52 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b" returned: 0 in 0.327s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b is being set with open permissions: ugo+rw Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b Jul 23 03:26:52 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.343s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416 Jul 23 03:26:52 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info Jul 23 03:26:52 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770.077409c8-fa39-42ed-b219-231c2ee70416" returned: 0 in 0.297s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-077409c8-fa39-42ed-b219-231c2ee70416" released by "_delete_snapshot" :: held 1.723s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_snapshot" :: held 1.763s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Created reservations ['e8cbcc78-e72f-4d8f-bd13-414e82fae68c', '8a9bda20-77b1-42fe-8633-7e71b9e75e7d', '9127a2b4-2857-478d-83c7-775382453b74', '4bc7019b-1ddd-4531-b449-fd61078c4874'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Delete snapshot completed successfully. Jul 23 03:26:52 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a5acf041-9763-42e6-93e8-6edc391f240b tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-077409c8-fa39-42ed-b219-231c2ee70416-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info is being set with open permissions: ugo+rw Jul 23 03:26:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info Jul 23 03:26:52 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "cinder-36bd313f-9ef3-41b1-969a-67ff6b1ce770-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-36bd313f-9ef3-41b1-969a-67ff6b1ce770-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:53 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.info" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-697481889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145297c5-fe9d-443b-a4ce-530f7596b83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b316ed6b5598437d89494c018ac26135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:51Z,use_quota=True,user_id='f2fcb181852c4df398504da759b67ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Creating volume 145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e 1073741824 Jul 23 03:26:53 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-43d855b7-1afe-410c-a35c-32765c931ebc tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Create snapshot completed successfully Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Flow 'volume_create_manager' (2659334d-4c3e-4839-adc3-e139011552f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72d88fa-de2e-41cc-b854-71ffa1196590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[512facf4-70b8-45de-acee-053071887599]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72d88fa-de2e-41cc-b854-71ffa1196590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1723291200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f469db-f846-4ed7-a352-d7767a9d64ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450b81b9910b433b90cca0140c04eed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:53Z,use_quota=True,user_id='776816984bb44286aa86ba6ebf630403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e09b10-f9e2-4bcb-97f0-6b818a9e7b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e09b10-f9e2-4bcb-97f0-6b818a9e7b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa6e131-110d-446b-b1fc-b1bdbdf95ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa6e131-110d-446b-b1fc-b1bdbdf95ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f469db-f846-4ed7-a352-d7767a9d64ff', 'volume_name': 'volume-19f469db-f846-4ed7-a352-d7767a9d64ff', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e329ad-dacc-4d4c-b073-658f12d50974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e329ad-dacc-4d4c-b073-658f12d50974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e89c5-84f5-4eb9-a4e6-8229a5bcb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Volume 19f469db-f846-4ed7-a352-d7767a9d64ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f469db-f846-4ed7-a352-d7767a9d64ff', 'volume_size': 1} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:53 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 Jul 23 03:26:53 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e 1073741824" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:26:53 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770" returned: 0 in 0.391s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770 Jul 23 03:26:53 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1723291200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f469db-f846-4ed7-a352-d7767a9d64ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450b81b9910b433b90cca0140c04eed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:53Z,use_quota=True,user_id='776816984bb44286aa86ba6ebf630403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Creating volume 19f469db-f846-4ed7-a352-d7767a9d64ff {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:26:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee179a16-d375-46ee-8bc3-f289e4b45a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145297c5-fe9d-443b-a4ce-530f7596b83e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc3f35-157a-4a83-887d-2d7ceda7c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:54 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff 1073741824 Jul 23 03:26:54 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-36bd313f-9ef3-41b1-969a-67ff6b1ce770" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Volume volume-145297c5-fe9d-443b-a4ce-530f7596b83e (145297c5-fe9d-443b-a4ce-530f7596b83e): created successfully Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc3f35-157a-4a83-887d-2d7ceda7c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (57160b24-2d4f-4c0a-bd35-5262c15c61ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-quobyte-36bd313f-9ef3-41b1-969a-67ff6b1ce770" released by "delete_volume" :: held 0.775s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9eed683d-dc9c-454b-aff9-b995d06eb320 tempest-VolumesDeleteCascade-368272135 None] Created volume successfully. Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Created reservations ['9a5553d2-794e-48d5-87bf-4d12f074672c', '9269a634-bdd6-425e-a6e4-60fc80250cb7', '6838f130-7a4a-4af5-b77e-0757e8e8fdf6', '740873f8-132f-4b5c-972f-3381c8748bfb'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:54 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "cinder-78d5227e-c6c4-443e-9f8b-abac80a7c55b-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-78d5227e-c6c4-443e-9f8b-abac80a7c55b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "cinder-quobyte-78d5227e-c6c4-443e-9f8b-abac80a7c55b" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-78d5227e-c6c4-443e-9f8b-abac80a7c55b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Deleting offline snapshot 78d5227e-c6c4-443e-9f8b-abac80a7c55b of volume 8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] snapshot_file for this snap is: volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46c65b5-7e34-4402-b2da-7e5555a2083a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.392s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Deleted volume successfully. Jul 23 03:26:54 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff 1073741824" returned: 0 in 0.704s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-097bc114-f464-4488-906e-bc577681526c tempest-SnapshotsActionsTest-427657478 None] Lock "cinder-36bd313f-9ef3-41b1-969a-67ff6b1ce770-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:54 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b Jul 23 03:26:54 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff Jul 23 03:26:54 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:55 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff" returned: 0 in 0.281s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.229s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:55 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e89c5-84f5-4eb9-a4e6-8229a5bcb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f469db-f846-4ed7-a352-d7767a9d64ff', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b25010b-906f-4242-ae6c-203db96dc27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8160d6f0-a2f5-49ef-a152-521ecabbb774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Creating offline snapshot 6986bca4-17d5-4032-be57-dbb1729a9c12 of volume 145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2bd487-a3a9-4172-a33c-d4684204b1b6]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Volume volume-19f469db-f846-4ed7-a352-d7767a9d64ff (19f469db-f846-4ed7-a352-d7767a9d64ff): created successfully Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b25010b-906f-4242-ae6c-203db96dc27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Flow 'volume_create_manager' (2659334d-4c3e-4839-adc3-e139011552f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927e6a0-e45c-498e-8974-25289d46c021]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cd207e7c-2ac4-49a9-92ba-2c7ece67c011 tempest-VolumesTransfersTest-1294347172 None] Created volume successfully. Jul 23 03:26:55 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 Jul 23 03:26:55 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:26:55 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774" returned: 0 in 0.491s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b Jul 23 03:26:55 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 1G Jul 23 03:26:55 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "cinder-19f469db-f846-4ed7-a352-d7767a9d64ff-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-19f469db-f846-4ed7-a352-d7767a9d64ff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "cinder-quobyte-19f469db-f846-4ed7-a352-d7767a9d64ff" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-quobyte-19f469db-f846-4ed7-a352-d7767a9d64ff" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b0377-a9f0-4555-a6ee-d17ff923fd32]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff Jul 23 03:26:56 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b" returned: 0 in 0.551s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b Jul 23 03:26:56 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 1G" returned: 0 in 0.647s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:26:56 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff" returned: 0 in 0.471s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff Jul 23 03:26:56 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774.78d5227e-c6c4-443e-9f8b-abac80a7c55b" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-78d5227e-c6c4-443e-9f8b-abac80a7c55b" released by "_delete_snapshot" :: held 2.113s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" released by "delete_snapshot" :: held 2.144s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Created reservations ['12eabb28-f4ab-4fe7-b0c1-4b3b9a0d6e67', 'd2990cf7-d12f-4542-9f5f-a9d41376ab85', '55f4905b-c512-43d3-be98-9e553ae8ad82', 'd3690d9a-ff56-4ba6-a288-db49f7361bbe'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:56 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 is being set with open permissions: ugo+rw Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-19f469db-f846-4ed7-a352-d7767a9d64ff" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:26:56 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Delete snapshot completed successfully. Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-quobyte-19f469db-f846-4ed7-a352-d7767a9d64ff" released by "delete_volume" :: held 0.894s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1e230727-42ce-4f1f-8679-54f0bad28448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-78d5227e-c6c4-443e-9f8b-abac80a7c55b-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Created reservations ['01efdb4c-5a84-45ef-b000-dad411b89dab', '50dac980-26ef-47eb-9940-898261c634ec', '804c2207-2039-4402-bfb5-4942bcd1c063', '09796e4d-9003-4f3d-a2b0-5a10d5b4e052'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:57 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:57 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.369s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:57 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info Jul 23 03:26:57 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Deleted volume successfully. Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7b640e1b-70e1-462a-878e-7b61d271a3dc tempest-VolumesTransfersTest-1928683384 None] Lock "cinder-19f469db-f846-4ed7-a352-d7767a9d64ff-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:57 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info" returned: 0 in 0.366s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info is being set with open permissions: ugo+rw Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:57 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info Jul 23 03:26:57 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "cinder-8160d6f0-a2f5-49ef-a152-521ecabbb774-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-8160d6f0-a2f5-49ef-a152-521ecabbb774-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:57 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.info" returned: 0 in 0.409s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f406f-0f42-49b6-9099-b881d5224212]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a707eaf0-d826-404b-9dc0-db8e543348c5 tempest-VolumesDeleteCascade-368272135 None] Create snapshot completed successfully Jul 23 03:26:58 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 Jul 23 03:26:58 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774" returned: 0 in 0.427s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774 Jul 23 03:26:58 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8160d6f0-a2f5-49ef-a152-521ecabbb774" returned: 0 in 0.284s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-quobyte-8160d6f0-a2f5-49ef-a152-521ecabbb774" released by "delete_volume" :: held 0.822s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Created reservations ['186ff639-ca50-4dd9-8637-a1359c61c972', '6308d642-9ac4-4bea-8f26-a86e1eea94c7', 'fce539c0-a785-43a2-853d-823f3a73ffe6', '9973cd44-8728-4c04-bbf3-8a931a73a00a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:26:58 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:59 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.500s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Deleted volume successfully. Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Creating offline snapshot d1265794-1b5b-40da-a987-9793cfe57112 of volume 145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0ac1af27-b893-435e-831e-47f29b2006f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645608893 None] Lock "cinder-8160d6f0-a2f5-49ef-a152-521ecabbb774-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d590c97-11ac-4680-98f8-0781206da9f9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:26:59 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.541s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145297c5-fe9d-443b-a4ce-530f7596b83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 1G Jul 23 03:27:00 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 1G" returned: 0 in 0.626s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:00 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.444s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:01 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 is being set with open permissions: ugo+rw Jul 23 03:27:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:01 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:01 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:01 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-59652265-73d8-4ba2-ab51-9e35edd0af91 tempest-VolumesDeleteCascade-368272135 None] Create snapshot completed successfully Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-145297c5-fe9d-443b-a4ce-530f7596b83e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-145297c5-fe9d-443b-a4ce-530f7596b83e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Performing cascade delete. {{(pid=88044) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-6986bca4-17d5-4032-be57-dbb1729a9c12-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-6986bca4-17d5-4032-be57-dbb1729a9c12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-6986bca4-17d5-4032-be57-dbb1729a9c12" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-6986bca4-17d5-4032-be57-dbb1729a9c12" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Deleting offline snapshot 6986bca4-17d5-4032-be57-dbb1729a9c12 of volume 145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] snapshot_file for this snap is: volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e030f1-411e-4e01-a4f6-a1ad0c5ff420]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:03 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:27:03 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:03 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.529s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145297c5-fe9d-443b-a4ce-530f7596b83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca6c882-4ac8-4ea0-b437-d8718488b68f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:03 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:27:03 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:04 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.587s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[49143314-b88d-474a-a5ba-1e060a2cc767]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:04 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:04 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:04 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.485s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145297c5-fe9d-443b-a4ce-530f7596b83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac82f8d-d72f-464a-8518-9d62ca2c264a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:04 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:27:04 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.558s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145297c5-fe9d-443b-a4ce-530f7596b83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a4fef-1e43-4298-a847-183b948df79d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:05 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:27:05 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.541s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:05 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:27:05 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:06 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:06 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12 Jul 23 03:27:06 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:06 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.6986bca4-17d5-4032-be57-dbb1729a9c12" returned: 0 in 0.319s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 -F qcow2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:06 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 -F qcow2 Jul 23 03:27:06 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:06 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145297c5-fe9d-443b-a4ce-530f7596b83e /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 -F qcow2" returned: 0 in 0.338s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-6986bca4-17d5-4032-be57-dbb1729a9c12" released by "_delete_snapshot" :: held 4.044s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" released by "delete_snapshot" :: held 4.076s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:06 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=130,cinder:UPDATE=152,cinder:INSERT=43,cinder:DELETE=11 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Created reservations ['73b72fcf-0169-479f-9720-905343bd03e7', '348b16fa-5d9c-4f14-b9ea-0e5230a94086', '8fc5224e-2ec8-49a1-9a39-21294ee38536', 'd0cf55eb-d0d9-4e9b-96ba-2fcb8ad8f177'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Delete snapshot completed successfully. Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-6986bca4-17d5-4032-be57-dbb1729a9c12-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-d1265794-1b5b-40da-a987-9793cfe57112-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-d1265794-1b5b-40da-a987-9793cfe57112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-d1265794-1b5b-40da-a987-9793cfe57112" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-d1265794-1b5b-40da-a987-9793cfe57112" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Deleting offline snapshot d1265794-1b5b-40da-a987-9793cfe57112 of volume 145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] snapshot_file for this snap is: volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbed383-c1b0-4da6-a96f-ca403cbe6218]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:07 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.509s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145297c5-fe9d-443b-a4ce-530f7596b83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c431c5-21e0-48fb-a3af-99442b8667e3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:27:08 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Flow 'volume_create_manager' (0c3366cd-5fd2-42be-bd7e-8c858fcf9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c804b0-9dd3-4d28-b88d-f1039b621819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:08 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c804b0-9dd3-4d28-b88d-f1039b621819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304019726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011443df-2594-4ad2-ab1f-7b5653a0e220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d57bbda677541d099c90a8f35bab5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:08Z,use_quota=True,user_id='9784a6ee238d42d089517be88f72e684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:08 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42743e78-6dba-433f-b8fc-518b1b26313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:08 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42743e78-6dba-433f-b8fc-518b1b26313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82a18e6-5d70-4897-ac74-fa06abbbde78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82a18e6-5d70-4897-ac74-fa06abbbde78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011443df-2594-4ad2-ab1f-7b5653a0e220', 'volume_name': 'volume-011443df-2594-4ad2-ab1f-7b5653a0e220', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901c789e-7c82-4df5-b951-101d9eb862d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901c789e-7c82-4df5-b951-101d9eb862d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09f7ff3-8eef-49f9-850b-33d5d05494ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Volume 011443df-2594-4ad2-ab1f-7b5653a0e220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011443df-2594-4ad2-ab1f-7b5653a0e220', 'volume_size': 1} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304019726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011443df-2594-4ad2-ab1f-7b5653a0e220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d57bbda677541d099c90a8f35bab5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:08Z,use_quota=True,user_id='9784a6ee238d42d089517be88f72e684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Creating volume 011443df-2594-4ad2-ab1f-7b5653a0e220 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:08 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 1073741824 Jul 23 03:27:08 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.417s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112 Jul 23 03:27:08 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 1073741824" returned: 0 in 0.585s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e.d1265794-1b5b-40da-a987-9793cfe57112" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 Jul 23 03:27:09 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-d1265794-1b5b-40da-a987-9793cfe57112" released by "_delete_snapshot" :: held 2.084s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" released by "delete_snapshot" :: held 2.121s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Created reservations ['27911943-da6e-45f8-b472-a56fe3e7e81c', '06a4a25a-959c-4bc4-8bc4-db5347743ab3', 'd4c25b02-eb09-4b73-9157-8616506cb49f', 'e0ab57bf-68cd-4d46-a097-367d428b43e5'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Delete snapshot completed successfully. Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-d1265794-1b5b-40da-a987-9793cfe57112-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Snapshots deleted, issuing volume delete {{(pid=88044) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:09 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220" returned: 0 in 0.441s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a59d05d-b336-4f41-95e1-d67fbf7c798a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09f7ff3-8eef-49f9-850b-33d5d05494ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011443df-2594-4ad2-ab1f-7b5653a0e220', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b28da7-28b6-49da-8822-d58c02aa7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Volume volume-011443df-2594-4ad2-ab1f-7b5653a0e220 (011443df-2594-4ad2-ab1f-7b5653a0e220): created successfully Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b28da7-28b6-49da-8822-d58c02aa7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Flow 'volume_create_manager' (0c3366cd-5fd2-42be-bd7e-8c858fcf9815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d68b4929-7ee3-46c0-af70-eb415df32b81 tempest-VolumesTransfersV357Test-2050773741 None] Created volume successfully. Jul 23 03:27:09 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:27:09 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e Jul 23 03:27:10 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-145297c5-fe9d-443b-a4ce-530f7596b83e" returned: 0 in 0.341s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-145297c5-fe9d-443b-a4ce-530f7596b83e" released by "delete_volume" :: held 0.836s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Created reservations ['bec62ac7-0bcd-4182-97f7-958eccede047', '665b40c7-1f9f-46b7-9fe0-ebcdc9eeb6d0', '0a3955be-2d93-4168-9c41-6d90635fa570', '3b126260-3cf7-4b2c-a07b-e044e53f98ce'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Flow 'volume_create_manager' (d523ffe1-6ff5-46a4-9122-b117adf3ec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477bfe0e-a6de-4e69-8fa9-03af2eda0dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477bfe0e-a6de-4e69-8fa9-03af2eda0dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-853554269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178ff415-f334-4af9-b30e-4e9727c54d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb476121e0140e59c04c074899d8909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:11Z,use_quota=True,user_id='e2015a4d8f6847258f4bfafbeeb691a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b1b42b-fbb4-48ba-b51e-0927cb152b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b1b42b-fbb4-48ba-b51e-0927cb152b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9905613b-ae41-44b6-a727-30970e036586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9905613b-ae41-44b6-a727-30970e036586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178ff415-f334-4af9-b30e-4e9727c54d9b', 'volume_name': 'volume-178ff415-f334-4af9-b30e-4e9727c54d9b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428fbf5d-2362-484b-9a65-8eb598991afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428fbf5d-2362-484b-9a65-8eb598991afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0131bf59-1389-4a5f-8f56-50c747637cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Volume 178ff415-f334-4af9-b30e-4e9727c54d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178ff415-f334-4af9-b30e-4e9727c54d9b', 'volume_size': 1} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-853554269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178ff415-f334-4af9-b30e-4e9727c54d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb476121e0140e59c04c074899d8909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:11Z,use_quota=True,user_id='e2015a4d8f6847258f4bfafbeeb691a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Creating volume 178ff415-f334-4af9-b30e-4e9727c54d9b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:10 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b 1073741824 Jul 23 03:27:10 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:10 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.338s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Deleted volume successfully. Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-40445476-8b70-46e7-a4df-d347ac38b466 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-145297c5-fe9d-443b-a4ce-530f7596b83e-delete_volume" released by "delete_volume" :: held 8.450s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:11 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b 1073741824" returned: 0 in 0.536s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:11 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b Jul 23 03:27:11 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cefa946d-f171-4d3d-9335-845431bc9d33 tempest-VolumesTransfersV357Test-1091010636 None] Transfer volume completed successfully. Jul 23 03:27:11 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b" returned: 0 in 0.366s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0131bf59-1389-4a5f-8f56-50c747637cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178ff415-f334-4af9-b30e-4e9727c54d9b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7340ffbe-a981-43c2-a82f-b13b978d6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Volume volume-178ff415-f334-4af9-b30e-4e9727c54d9b (178ff415-f334-4af9-b30e-4e9727c54d9b): created successfully Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7340ffbe-a981-43c2-a82f-b13b978d6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Flow 'volume_create_manager' (d523ffe1-6ff5-46a4-9122-b117adf3ec0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7c790736-04a2-46bd-b1d8-25893816103d tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Created volume successfully. Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "cinder-011443df-2594-4ad2-ab1f-7b5653a0e220-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-011443df-2594-4ad2-ab1f-7b5653a0e220-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "cinder-quobyte-011443df-2594-4ad2-ab1f-7b5653a0e220" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-quobyte-011443df-2594-4ad2-ab1f-7b5653a0e220" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a2998-c975-4975-af96-50e01be807c4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:12 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 Jul 23 03:27:12 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (4146b112-ab35-4ba1-90e4-a771325fbcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d958b9-b5fa-452a-af50-6fef3a576363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d958b9-b5fa-452a-af50-6fef3a576363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2059192457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc0c59f-52d9-4c63-9beb-8cfcd936fc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b316ed6b5598437d89494c018ac26135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:12Z,use_quota=True,user_id='f2fcb181852c4df398504da759b67ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4470be-6548-4a1a-8c10-d6d627248822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4470be-6548-4a1a-8c10-d6d627248822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8e85c6-a24c-4713-99ca-0f32c285a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8e85c6-a24c-4713-99ca-0f32c285a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc0c59f-52d9-4c63-9beb-8cfcd936fc47', 'volume_name': 'volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2c90d-ed25-437a-8810-4f3039c6ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2c90d-ed25-437a-8810-4f3039c6ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383696a1-9929-40df-b78c-2caeccf8fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Volume 3fc0c59f-52d9-4c63-9beb-8cfcd936fc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47', 'volume_size': 1} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2059192457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc0c59f-52d9-4c63-9beb-8cfcd936fc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b316ed6b5598437d89494c018ac26135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:12Z,use_quota=True,user_id='f2fcb181852c4df398504da759b67ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Creating volume 3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:12 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 1073741824 Jul 23 03:27:12 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220" returned: 0 in 0.451s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220 Jul 23 03:27:12 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 1073741824" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-011443df-2594-4ad2-ab1f-7b5653a0e220" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-quobyte-011443df-2594-4ad2-ab1f-7b5653a0e220" released by "delete_volume" :: held 0.860s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:13 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Created reservations ['6aae0b7a-015a-4336-94df-3d550b57ee95', 'c5fe1f3f-8e77-4a39-bcb0-2889dac59bb3', '7de66ac2-ea6d-43db-81f2-a72d4eddc8e8', '427f7dde-ac92-48e4-bcd1-0ba477a8840e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:13 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.508s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383696a1-9929-40df-b78c-2caeccf8fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a9fcda-2115-4ec1-b3a7-2d4326fd3855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Volume volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 (3fc0c59f-52d9-4c63-9beb-8cfcd936fc47): created successfully Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a9fcda-2115-4ec1-b3a7-2d4326fd3855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (4146b112-ab35-4ba1-90e4-a771325fbcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.389s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Deleted volume successfully. Jul 23 03:27:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d6031a20-74e5-4d22-9c1a-60d2d1810646 tempest-VolumesDeleteCascade-368272135 None] Created volume successfully. Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9df57b11-38c2-4573-99c2-aa9469fd3e62 tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-011443df-2594-4ad2-ab1f-7b5653a0e220-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Acquiring lock "cinder-178ff415-f334-4af9-b30e-4e9727c54d9b-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "cinder-178ff415-f334-4af9-b30e-4e9727c54d9b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Acquiring lock "cinder-quobyte-178ff415-f334-4af9-b30e-4e9727c54d9b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "cinder-quobyte-178ff415-f334-4af9-b30e-4e9727c54d9b" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[413663a8-3995-4e17-bbfa-1ca03eb46d7c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:14 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b Jul 23 03:27:14 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Flow 'volume_create_manager' (cdbf52a8-197a-4622-b6fb-d9ede4244195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df291c6-69c9-4fdb-b70d-346d790e8303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df291c6-69c9-4fdb-b70d-346d790e8303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1861297515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fee582-1d86-48fa-894d-42d2a62e9231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d57bbda677541d099c90a8f35bab5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:14Z,use_quota=True,user_id='9784a6ee238d42d089517be88f72e684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf2267f-94ef-417e-b407-0915f71bb171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf2267f-94ef-417e-b407-0915f71bb171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e4e082-f203-428b-952e-1af7c10e2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e4e082-f203-428b-952e-1af7c10e2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fee582-1d86-48fa-894d-42d2a62e9231', 'volume_name': 'volume-b5fee582-1d86-48fa-894d-42d2a62e9231', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2d3899-b1d5-4089-be62-56195205304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2d3899-b1d5-4089-be62-56195205304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e9e7c0-6231-4e7f-83b5-83975b625ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Volume b5fee582-1d86-48fa-894d-42d2a62e9231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fee582-1d86-48fa-894d-42d2a62e9231', 'volume_size': 1} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1861297515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fee582-1d86-48fa-894d-42d2a62e9231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d57bbda677541d099c90a8f35bab5a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:14Z,use_quota=True,user_id='9784a6ee238d42d089517be88f72e684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Creating volume b5fee582-1d86-48fa-894d-42d2a62e9231 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:14 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 1073741824 Jul 23 03:27:14 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b" returned: 0 in 0.528s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b Jul 23 03:27:14 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:14 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-178ff415-f334-4af9-b30e-4e9727c54d9b" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "cinder-quobyte-178ff415-f334-4af9-b30e-4e9727c54d9b" released by "delete_volume" :: held 0.862s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:15 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 1073741824" returned: 0 in 0.597s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Created reservations ['b8141bd6-828f-4e1d-93a2-b8108b0a89ee', 'ffd9eeba-d1e4-44cd-aa05-7080b39a3710', '1bff4ad0-bafb-4364-bd13-53edf4ccc110', 'd35125cc-5007-4e1c-8abb-aa3c992b7746'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 Jul 23 03:27:15 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:15 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231" returned: 0 in 0.341s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.580s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e9e7c0-6231-4e7f-83b5-83975b625ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fee582-1d86-48fa-894d-42d2a62e9231', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300090e-0eff-4b17-91d7-a02c496cce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Creating offline snapshot 477f0ed6-d1af-4a3d-8926-0351cfaa30f7 of volume 3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:27:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Volume volume-b5fee582-1d86-48fa-894d-42d2a62e9231 (b5fee582-1d86-48fa-894d-42d2a62e9231): created successfully Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300090e-0eff-4b17-91d7-a02c496cce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Flow 'volume_create_manager' (cdbf52a8-197a-4622-b6fb-d9ede4244195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78f087e-f4a9-463c-96e6-f39d308b9d73]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-996dddaf-1698-4a63-8d4e-435f63f203df tempest-VolumesTransfersV357Test-2050773741 None] Created volume successfully. Jul 23 03:27:15 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.492s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Deleted volume successfully. Jul 23 03:27:15 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:15 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4dfd5c5-98dc-45ce-a1a2-8efe53a67602 tempest-VolumeQuotasNegativeTestJSON-2065288668 None] Lock "cinder-178ff415-f334-4af9-b30e-4e9727c54d9b-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:16 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.569s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:16 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 1G Jul 23 03:27:16 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 1G" returned: 0 in 0.522s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:16 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:16 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "cinder-b5fee582-1d86-48fa-894d-42d2a62e9231-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-b5fee582-1d86-48fa-894d-42d2a62e9231-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "cinder-quobyte-b5fee582-1d86-48fa-894d-42d2a62e9231" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-quobyte-b5fee582-1d86-48fa-894d-42d2a62e9231" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ed159-7415-4bd0-aa35-661e36027a46]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.489s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 is being set with open permissions: ugo+rw Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:17 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 Jul 23 03:27:17 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231" returned: 0 in 0.508s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info Jul 23 03:27:17 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231 Jul 23 03:27:17 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info is being set with open permissions: ugo+rw Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b5fee582-1d86-48fa-894d-42d2a62e9231" returned: 0 in 0.395s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info Jul 23 03:27:18 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-quobyte-b5fee582-1d86-48fa-894d-42d2a62e9231" released by "delete_volume" :: held 0.983s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Created reservations ['f651ed58-b661-4b0b-abfd-4728b1b3466d', '37206943-7950-46c3-8d41-4f7a824dfca0', '93ea3e12-a746-4884-bcc2-e275087d2693', '834a327f-7ac7-4893-b6c9-edc28b0a003f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:18 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:18 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.info" returned: 0 in 0.372s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-143a95ac-03b9-4703-8897-89cb38a59996 tempest-VolumesDeleteCascade-368272135 None] Create snapshot completed successfully Jul 23 03:27:18 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Deleted volume successfully. Jul 23 03:27:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6ab10025-a6a6-4037-a991-a9dbea774ecb tempest-VolumesTransfersV357Test-1380160037 None] Lock "cinder-b5fee582-1d86-48fa-894d-42d2a62e9231-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:19 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (ad402030-3109-4985-bd43-9c07b54cd1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:19 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd93cadc-6055-45b4-87a8-df455419b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd93cadc-6055-45b4-87a8-df455419b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1111613760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5044f976-0cdf-41cf-ac16-aa33271183cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b316ed6b5598437d89494c018ac26135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=477f0ed6-d1af-4a3d-8926-0351cfaa30f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:20Z,use_quota=True,user_id='f2fcb181852c4df398504da759b67ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6840ea-e722-4a65-a3d6-403765bf0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6840ea-e722-4a65-a3d6-403765bf0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f14b3a3-533a-4b59-a340-55bb955a6478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f14b3a3-533a-4b59-a340-55bb955a6478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5044f976-0cdf-41cf-ac16-aa33271183cf', 'volume_name': 'volume-5044f976-0cdf-41cf-ac16-aa33271183cf', 'volume_size': 1, 'snapshot_id': '477f0ed6-d1af-4a3d-8926-0351cfaa30f7'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bc1b9e-923c-4101-90fc-b541bf4fd5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bc1b9e-923c-4101-90fc-b541bf4fd5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2fc13b-ccd9-46c0-b553-c3f6bca5ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Volume 5044f976-0cdf-41cf-ac16-aa33271183cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5044f976-0cdf-41cf-ac16-aa33271183cf', 'volume_size': 1, 'snapshot_id': '477f0ed6-d1af-4a3d-8926-0351cfaa30f7'} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-5044f976-0cdf-41cf-ac16-aa33271183cf" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-5044f976-0cdf-41cf-ac16-aa33271183cf" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Creating volume 5044f976-0cdf-41cf-ac16-aa33271183cf from snapshot 477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] snapshot: 477f0ed6-d1af-4a3d-8926-0351cfaa30f7, volume: 5044f976-0cdf-41cf-ac16-aa33271183cf, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa39f905-dae1-4193-91ec-b53258959f9f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:20 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:20 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.443s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa9ea45-6cc9-4209-9bb4-65200255b8a9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:20 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:20 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:21 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.438s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:21 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:27:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf Jul 23 03:27:21 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:27 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf" returned: 0 in 6.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b151690-e1ea-4570-b314-c5f80a615d86]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:27 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:27 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Flow 'volume_create_manager' (7dc28458-9096-4af0-b934-9f1cdce5f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adb2924-684f-4cce-8965-d5aead50086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adb2924-684f-4cce-8965-d5aead50086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1018824449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4a5155-12f1-4af1-a0fd-ade2e741c8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54760b428864fdc9d61a71b50118bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:28Z,use_quota=True,user_id='453f5300caf64c6f847bd92fb57f572a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56982897-2b80-4ce4-8336-2456dcdc76b5),volume_type_id=56982897-2b80-4ce4-8336-2456dcdc76b5)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4eec1af-73c8-495d-b2ff-762b61498324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4eec1af-73c8-495d-b2ff-762b61498324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2751b688-fa14-49e8-8c0a-838e6d81bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2751b688-fa14-49e8-8c0a-838e6d81bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4a5155-12f1-4af1-a0fd-ade2e741c8df', 'volume_name': 'volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74c22f9-e20d-4484-ba39-d0f73baea49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74c22f9-e20d-4484-ba39-d0f73baea49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46413c-db5f-4d8a-80b5-2d4edea724e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Volume 7c4a5155-12f1-4af1-a0fd-ade2e741c8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df', 'volume_size': 1} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (81f87e70-0ea4-4197-b7fb-0dd805537100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1aa640-95f1-4fc8-adc2-b319f699a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1aa640-95f1-4fc8-adc2-b319f699a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037100845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:28Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86195a3c-2ca8-4b96-b152-2a3e3f2f20e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86195a3c-2ca8-4b96-b152-2a3e3f2f20e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedf9ee0-61f9-4c4a-b99d-341443f6d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedf9ee0-61f9-4c4a-b99d-341443f6d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef', 'volume_name': 'volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83825936-a8fa-4c6c-947f-cf2bfb441525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83825936-a8fa-4c6c-947f-cf2bfb441525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb840d5-5332-49b5-b8f1-b4bc0fa3e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Volume ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef', 'volume_size': 1} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:28 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.644s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Converted 1024.00 MB image at 156.50 MB/s Jul 23 03:27:28 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf is being set with open permissions: ugo+rw Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf Jul 23 03:27:28 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf" returned: 0 in 0.306s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" released by "_copy_volume_from_snapshot" :: held 8.517s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-5044f976-0cdf-41cf-ac16-aa33271183cf" released by "_create_volume_from_snapshot" :: held 8.553s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.571s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1018824449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4a5155-12f1-4af1-a0fd-ade2e741c8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54760b428864fdc9d61a71b50118bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:28Z,use_quota=True,user_id='453f5300caf64c6f847bd92fb57f572a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56982897-2b80-4ce4-8336-2456dcdc76b5),volume_type_id=56982897-2b80-4ce4-8336-2456dcdc76b5)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Creating volume 7c4a5155-12f1-4af1-a0fd-ade2e741c8df {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df 1073741824 Jul 23 03:27:28 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2fc13b-ccd9-46c0-b553-c3f6bca5ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5044f976-0cdf-41cf-ac16-aa33271183cf', 'volume_size': 1, 'snapshot_id': '477f0ed6-d1af-4a3d-8926-0351cfaa30f7'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6082d29-a635-40cc-a325-b3d2542d053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Volume volume-5044f976-0cdf-41cf-ac16-aa33271183cf (5044f976-0cdf-41cf-ac16-aa33271183cf): created successfully Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6082d29-a635-40cc-a325-b3d2542d053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Flow 'volume_create_manager' (ad402030-3109-4985-bd43-9c07b54cd1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9a5ac714-743c-4089-82a9-901bbcae78b7 tempest-VolumesDeleteCascade-368272135 None] Created volume successfully. Jul 23 03:27:29 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df 1073741824" returned: 0 in 0.558s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:29 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df Jul 23 03:27:29 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" returned: 0 in 0.301s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037100845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:28Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Creating volume ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:29 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:29 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef 1073741824 Jul 23 03:27:29 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46413c-db5f-4d8a-80b5-2d4edea724e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298298c4-b0e4-489e-9ff0-557289fd995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Volume volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df (7c4a5155-12f1-4af1-a0fd-ade2e741c8df): created successfully Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298298c4-b0e4-489e-9ff0-557289fd995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Flow 'volume_create_manager' (7dc28458-9096-4af0-b934-9f1cdce5f97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-58db7d60-0540-4ec5-b4c6-7e47998aa229 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Created volume successfully. Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Performing cascade delete. {{(pid=88044) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:30 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef 1073741824" returned: 0 in 0.693s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Deleting offline snapshot 477f0ed6-d1af-4a3d-8926-0351cfaa30f7 of volume 3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] snapshot_file for this snap is: volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[768114b4-945d-4c91-8b9f-6f82f3ce1b02]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef Jul 23 03:27:30 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:30 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:30 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:30 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:30 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" returned: 0 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb840d5-5332-49b5-b8f1-b4bc0fa3e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63e7397-78f1-4071-bd7e-6883765b884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:30 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Volume volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef (ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef): created successfully Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63e7397-78f1-4071-bd7e-6883765b884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (81f87e70-0ea4-4197-b7fb-0dd805537100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-770e9118-566e-457c-ba3a-d71f883442e3 tempest-VolumesListAdminTestJSON-1380324310 None] Created volume successfully. Jul 23 03:27:30 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.582s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:31 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[152a322b-eda3-4eb5-8c7a-cd350fd0d082]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-48f7e8dc-538a-4084-a8d2-288ce734006c tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Retype volume completed successfully. Jul 23 03:27:31 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:31 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:31 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.457s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:31 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:31 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (3ad47ae1-cda3-493d-a241-0d38e46f32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97920c5-4253-4a84-bacc-8be5872c59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97920c5-4253-4a84-bacc-8be5872c59cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132299939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6021e8-6fcb-4771-bd06-5760ffd818ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:32Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1868a821-0e6d-4521-a646-6b474fc139c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1868a821-0e6d-4521-a646-6b474fc139c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9f5c69-694a-4ea5-89c7-4ff1ccb7a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9f5c69-694a-4ea5-89c7-4ff1ccb7a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6021e8-6fcb-4771-bd06-5760ffd818ab', 'volume_name': 'volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbc55d-e75f-4c61-93cc-1937f4c03b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbc55d-e75f-4c61-93cc-1937f4c03b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dadfd9e-26a6-46bf-9693-f71bf0ded285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Volume ac6021e8-6fcb-4771-bd06-5760ffd818ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab', 'volume_size': 1} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132299939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6021e8-6fcb-4771-bd06-5760ffd818ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:32Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Creating volume ac6021e8-6fcb-4771-bd06-5760ffd818ab {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:32 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "cinder-7c4a5155-12f1-4af1-a0fd-ade2e741c8df-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.703s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:32 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab 1073741824 Jul 23 03:27:32 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "cinder-7c4a5155-12f1-4af1-a0fd-ade2e741c8df-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7 Jul 23 03:27:32 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "cinder-quobyte-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "cinder-quobyte-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aeb2c3-c362-40c3-aea8-eeec495f19ce]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df Jul 23 03:27:32 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47.477f0ed6-d1af-4a3d-8926-0351cfaa30f7" returned: 0 in 0.349s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-477f0ed6-d1af-4a3d-8926-0351cfaa30f7" released by "_delete_snapshot" :: held 2.279s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" released by "delete_snapshot" :: held 2.315s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Created reservations ['762a0cab-b32d-4c60-a40f-f9188a878e07', 'fcf0ffe8-9e27-4409-b50a-6faf8f07499b', '36df1318-7187-47ca-9c21-5c5cf9713ae0', 'b9b35894-002c-4a92-ad84-cff6f1d98311'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:32 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab 1073741824" returned: 0 in 0.628s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:32 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Delete snapshot completed successfully. Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" returned: 0 in 0.505s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-477f0ed6-d1af-4a3d-8926-0351cfaa30f7-delete_snapshot" released by "delete_snapshot" :: held 2.657s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Snapshots deleted, issuing volume delete {{(pid=88044) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df Jul 23 03:27:32 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[167033c5-65b5-4515-8ccd-db18a098e608]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:33 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab Jul 23 03:27:33 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:33 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" returned: 0 in 0.355s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "cinder-quobyte-7c4a5155-12f1-4af1-a0fd-ade2e741c8df" released by "delete_volume" :: held 0.942s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:33 devstack cinder-volume[88044]: WARNING cinder.quota [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:27:33 devstack cinder-volume[88044]: WARNING cinder.quota [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:27:33 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab" returned: 0 in 0.409s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dadfd9e-26a6-46bf-9693-f71bf0ded285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5493eba-8637-403b-9df9-fdee786de76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Created reservations ['0302fcb1-94dc-4a29-af3c-87a5f5e77bbc', 'e67bba02-58bd-4eb8-97f8-d327f03da783', 'ad8eea77-786b-4092-a916-da897bcf47d3', '79f1444e-98e7-49c2-917b-ae0bbdd07da6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Volume volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab (ac6021e8-6fcb-4771-bd06-5760ffd818ab): created successfully Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5493eba-8637-403b-9df9-fdee786de76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (3ad47ae1-cda3-493d-a241-0d38e46f32e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5c6e0e06-23fa-4176-a2a3-77d68e0312b9 tempest-VolumesListAdminTestJSON-1380324310 None] Created volume successfully. Jul 23 03:27:33 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.583s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:33 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47 Jul 23 03:27:33 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:33 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:33 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47" released by "delete_volume" :: held 0.954s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:33 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Deleted volume successfully. Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Created reservations ['b820b4b1-8276-4dc1-9753-b04f1ef78813', 'dcde809c-9b21-4653-87ab-e7f61eca73d2', '96e7689c-6ac0-4257-8a9e-314312d6e13c', 'ae40b3e9-0e4a-4c6b-94d4-1f35b7c7184f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-27f0ebee-c98a-40eb-8f82-9f970fc416a3 tempest-VolumeRetypeWithoutMigrationTest-1455546309 None] Lock "cinder-7c4a5155-12f1-4af1-a0fd-ade2e741c8df-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:34 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:34 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:34 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Deleted volume successfully. Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-13254d0b-eb56-4725-b24d-d72a61b80859 tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-3fc0c59f-52d9-4c63-9beb-8cfcd936fc47-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (f400f867-ddf9-47d5-b7ad-927d8f29ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdc275d-9480-4d76-a0fb-7fd656b420ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-5044f976-0cdf-41cf-ac16-aa33271183cf-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdc275d-9480-4d76-a0fb-7fd656b420ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876204135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3caee98-1f1f-48e1-b769-22c6bbabe2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:35Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e260b64-e3e3-4192-b626-398072f35a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e260b64-e3e3-4192-b626-398072f35a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8759353f-cb16-4f7d-88db-6ad27b12de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8759353f-cb16-4f7d-88db-6ad27b12de00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3caee98-1f1f-48e1-b769-22c6bbabe2ae', 'volume_name': 'volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ceb10-9539-4e48-957d-a2696d2e3061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ceb10-9539-4e48-957d-a2696d2e3061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d3c3e4-ebf3-428a-bd88-c88994a81fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Volume f3caee98-1f1f-48e1-b769-22c6bbabe2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae', 'volume_size': 1} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876204135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3caee98-1f1f-48e1-b769-22c6bbabe2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33168a6b82f4f9fb9d29ab38fce1dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:35Z,use_quota=True,user_id='910df357d5c54dc5bab7c56f94ffd86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Creating volume f3caee98-1f1f-48e1-b769-22c6bbabe2ae {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:35 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-5044f976-0cdf-41cf-ac16-aa33271183cf-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:35 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae 1073741824 Jul 23 03:27:35 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3c843-4975-4ee3-98c7-648395af3412]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf Jul 23 03:27:35 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:35 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf" returned: 0 in 0.575s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae 1073741824" returned: 0 in 0.741s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:35 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf Jul 23 03:27:35 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:35 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:35 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae Jul 23 03:27:35 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5044f976-0cdf-41cf-ac16-aa33271183cf" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" returned: 0 in 0.389s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-quobyte-5044f976-0cdf-41cf-ac16-aa33271183cf" released by "delete_volume" :: held 1.109s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:36 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.433s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d3c3e4-ebf3-428a-bd88-c88994a81fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6faec4-c4d0-449e-9ec5-f5f4af7aa88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:36 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Volume volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae (f3caee98-1f1f-48e1-b769-22c6bbabe2ae): created successfully Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6faec4-c4d0-449e-9ec5-f5f4af7aa88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Flow 'volume_create_manager' (f400f867-ddf9-47d5-b7ad-927d8f29ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-81f88865-e65f-4c82-a0b4-77d7e2ef89ae tempest-VolumesListAdminTestJSON-1380324310 None] Created volume successfully. Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Created reservations ['c7b03f2a-5464-4b17-b08d-4f797c5eb9e4', 'ad7851d4-fcf6-4fbf-be92-feb83476c258', '3ad93eb3-baf2-4007-aed7-823f3164ed14', '33b233b2-1c99-4376-bee1-778df8d48d46'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:36 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:36 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Deleted volume successfully. Jul 23 03:27:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79bbe233-df82-466f-8ef6-ce478d80a50c tempest-VolumesDeleteCascade-368272135 None] Lock "cinder-5044f976-0cdf-41cf-ac16-aa33271183cf-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Flow 'volume_create_manager' (c4be4ff8-35f2-4964-a830-9ac0ccf79772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f80090-34e6-41ba-b8ff-7edb9464447f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f80090-34e6-41ba-b8ff-7edb9464447f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db124b5f-280c-4740-8c20-b088ef6c1957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e263042794ae426ebae74e1508f8214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:38Z,use_quota=True,user_id='fc8149297b3b4f378b2426412cd51039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06f2c6e-7e85-41e9-a033-7dada20dc228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06f2c6e-7e85-41e9-a033-7dada20dc228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22c20e-39d0-4ca4-b5cc-502f244d5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22c20e-39d0-4ca4-b5cc-502f244d5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db124b5f-280c-4740-8c20-b088ef6c1957', 'volume_name': 'volume-db124b5f-280c-4740-8c20-b088ef6c1957', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f32ec0-8f0f-4170-87a7-aaf053d470c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f32ec0-8f0f-4170-87a7-aaf053d470c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be6c64b-5211-4112-8b1e-fef997bbf1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Volume db124b5f-280c-4740-8c20-b088ef6c1957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db124b5f-280c-4740-8c20-b088ef6c1957', 'volume_size': 1} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db124b5f-280c-4740-8c20-b088ef6c1957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e263042794ae426ebae74e1508f8214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:38Z,use_quota=True,user_id='fc8149297b3b4f378b2426412cd51039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Creating volume db124b5f-280c-4740-8c20-b088ef6c1957 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:38 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:38 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 1073741824 Jul 23 03:27:38 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:38 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 1073741824" returned: 0 in 0.593s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:39 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 Jul 23 03:27:39 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:39 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be6c64b-5211-4112-8b1e-fef997bbf1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db124b5f-280c-4740-8c20-b088ef6c1957', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe6d2d-8c63-478b-9ec8-36e3943f45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Volume volume-db124b5f-280c-4740-8c20-b088ef6c1957 (db124b5f-280c-4740-8c20-b088ef6c1957): created successfully Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe6d2d-8c63-478b-9ec8-36e3943f45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Flow 'volume_create_manager' (c4be4ff8-35f2-4964-a830-9ac0ccf79772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b2a8b391-fda2-4ec5-ba4f-b1dcd6e8d9d6 tempest-VolumesListAdminTestJSON-319759700 None] Created volume successfully. Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Acquiring lock "cinder-db124b5f-280c-4740-8c20-b088ef6c1957-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "cinder-db124b5f-280c-4740-8c20-b088ef6c1957-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:DELETE=16,cinder:SELECT=151,cinder:INSERT=44,cinder:UPDATE=179 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Acquiring lock "cinder-quobyte-db124b5f-280c-4740-8c20-b088ef6c1957" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "cinder-quobyte-db124b5f-280c-4740-8c20-b088ef6c1957" acquired by "delete_volume" :: waited 0.038s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7cfd3-03b2-4bdf-90b7-073f61b5395e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-f3caee98-1f1f-48e1-b769-22c6bbabe2ae-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-f3caee98-1f1f-48e1-b769-22c6bbabe2ae-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-quobyte-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1eb564-3c7e-456b-af33-04d0011f5d07]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:40 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 Jul 23 03:27:40 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:41 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae Jul 23 03:27:41 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:41 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957" returned: 0 in 0.867s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:41 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957 Jul 23 03:27:41 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:41 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" returned: 0 in 0.707s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:41 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae Jul 23 03:27:41 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-db124b5f-280c-4740-8c20-b088ef6c1957" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "cinder-quobyte-db124b5f-280c-4740-8c20-b088ef6c1957" released by "delete_volume" :: held 1.495s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:42 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" returned: 0 in 0.545s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-f3caee98-1f1f-48e1-b769-22c6bbabe2ae" released by "delete_volume" :: held 1.351s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Created reservations ['61cc836e-1b1f-46a6-811c-0140966de531', '56041902-e2b5-4ed4-9990-403ab3dc962c', '35dd642b-7d7f-447b-bfeb-705d8211a6e4', '01768c87-4a92-4ea2-a831-222df6f464b4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Created reservations ['d72e8eb0-5132-455b-9cb0-1c865605070e', '9bd9dcc0-e2e1-42cf-b78b-3cf013c71557', '866fcdf6-ddae-4d2b-bcb0-d4d8e405e18b', '6f5b7a90-f78f-44f7-940e-5ed8d53b3561'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:42 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:42 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:42 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:42 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.421s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Deleted volume successfully. Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-733c274c-afda-4914-8356-cbdc636642a6 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-f3caee98-1f1f-48e1-b769-22c6bbabe2ae-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:43 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.637s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Deleted volume successfully. Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-067fb94d-3211-47e4-9e32-3e86c867f544 tempest-VolumesListAdminTestJSON-319759700 None] Lock "cinder-db124b5f-280c-4740-8c20-b088ef6c1957-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-ac6021e8-6fcb-4771-bd06-5760ffd818ab-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-ac6021e8-6fcb-4771-bd06-5760ffd818ab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-quobyte-ac6021e8-6fcb-4771-bd06-5760ffd818ab" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-ac6021e8-6fcb-4771-bd06-5760ffd818ab" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[555a82e6-9c74-4a61-9a52-8a3039b2048a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab Jul 23 03:27:43 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab" returned: 0 in 0.612s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab Jul 23 03:27:44 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ac6021e8-6fcb-4771-bd06-5760ffd818ab" returned: 0 in 0.376s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-ac6021e8-6fcb-4771-bd06-5760ffd818ab" released by "delete_volume" :: held 1.070s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Created reservations ['7f67fbc0-6e37-481c-b2ea-37b88fdf5674', 'd183cde7-97e6-4157-95d6-c7b2b0c3d0df', 'cefb893b-65fe-4d55-b20b-479b789b6470', '2b60c5c4-6753-4608-b3e7-0b44d69c6575'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:44 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.322s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Deleted volume successfully. Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cf3c90c-433e-4818-ae8e-4a4331b27850 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-ac6021e8-6fcb-4771-bd06-5760ffd818ab-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Flow 'volume_create_manager' (6b0869bd-dcde-47da-9bd0-fc89e35b0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376d0ef5-7c5e-4e20-a55d-cf7862c99706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376d0ef5-7c5e-4e20-a55d-cf7862c99706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-921089327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df59abe-49dc-4374-bba4-6e2dd7f16de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6e1493c1e5403aab8eaf5a63560691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:45Z,use_quota=True,user_id='83a659c88d7e4ae2b1eae4519f73a2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539019a-5a98-44e1-93ba-bcfe416acd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539019a-5a98-44e1-93ba-bcfe416acd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaafb269-a1bb-46b3-807f-1abcd25226ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaafb269-a1bb-46b3-807f-1abcd25226ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'volume_name': 'volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b728661-837f-4e5c-a027-6c90e2721774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b728661-837f-4e5c-a027-6c90e2721774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943a9957-9bbe-4a30-9db4-0ad0a9b6b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Volume 9df59abe-49dc-4374-bba4-6e2dd7f16de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'volume_size': 1} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-921089327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df59abe-49dc-4374-bba4-6e2dd7f16de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6e1493c1e5403aab8eaf5a63560691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:45Z,use_quota=True,user_id='83a659c88d7e4ae2b1eae4519f73a2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Creating volume 9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:45 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 1073741824 Jul 23 03:27:45 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Flow 'volume_create_manager' (17c36eea-745b-47ee-8c4b-c902f6b89ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42430d12-9cec-4ed4-ae62-cfc89484ca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42430d12-9cec-4ed4-ae62-cfc89484ca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632128812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689a8ec-670f-4fba-b886-a89c12625338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d77e6b57ae14c06ac645564dbb98e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:46Z,use_quota=True,user_id='bc08bed9aedd40a98877394ab25de46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a068bd-f7e8-48e6-a9e1-29c8e2c58b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a068bd-f7e8-48e6-a9e1-29c8e2c58b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fefd855-c5fa-46d5-8eb5-6406c4f2fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fefd855-c5fa-46d5-8eb5-6406c4f2fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b689a8ec-670f-4fba-b886-a89c12625338', 'volume_name': 'volume-b689a8ec-670f-4fba-b886-a89c12625338', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cba4c1-3638-4288-b82e-97b691a34e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cba4c1-3638-4288-b82e-97b691a34e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84398bc-b274-40fd-a5a3-11a4daf9ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Volume b689a8ec-670f-4fba-b886-a89c12625338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b689a8ec-670f-4fba-b886-a89c12625338', 'volume_size': 1} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "cinder-quobyte-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[69707193-5e3e-481a-8079-1e28da44e922]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 1073741824" returned: 0 in 0.736s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef Jul 23 03:27:45 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:27:46 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.321s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632128812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689a8ec-670f-4fba-b886-a89c12625338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d77e6b57ae14c06ac645564dbb98e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:46Z,use_quota=True,user_id='bc08bed9aedd40a98877394ab25de46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Creating volume b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:46 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef Jul 23 03:27:46 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:46 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943a9957-9bbe-4a30-9db4-0ad0a9b6b674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:46 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 1073741824 Jul 23 03:27:46 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0593a6a5-64c6-47eb-9ddd-c3134e3cc7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Volume volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 (9df59abe-49dc-4374-bba4-6e2dd7f16de7): created successfully Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0593a6a5-64c6-47eb-9ddd-c3134e3cc7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Flow 'volume_create_manager' (6b0869bd-dcde-47da-9bd0-fc89e35b0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e1a1511c-075b-45c1-a5bf-802ceff0a1ed tempest-VolumesCloneTest-1832499474 None] Created volume successfully. Jul 23 03:27:46 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" returned: 0 in 0.375s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-quobyte-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef" released by "delete_volume" :: held 0.903s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Created reservations ['03ff4184-44ce-4646-b47a-3be3852d4ab0', '75e73ca2-a8c4-4218-ab68-591cbb4f0856', '23b57c07-76dc-44ac-96b4-b381fba738c7', '15c94ebb-16cf-4f7c-9130-776cbcd2c6db'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:27:46 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 1073741824" returned: 0 in 0.716s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:27:47 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.386s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Deleted volume successfully. Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0a3385ca-dd61-41ad-9947-a58364c60b81 tempest-VolumesListAdminTestJSON-1380324310 None] Lock "cinder-ea8f4946-e5a9-4e45-9d86-2a33e35bc5ef-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:47 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.497s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84398bc-b274-40fd-a5a3-11a4daf9ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b689a8ec-670f-4fba-b886-a89c12625338', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db412d-1903-431e-bdd1-def5552cbc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Volume volume-b689a8ec-670f-4fba-b886-a89c12625338 (b689a8ec-670f-4fba-b886-a89c12625338): created successfully Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db412d-1903-431e-bdd1-def5552cbc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Flow 'volume_create_manager' (17c36eea-745b-47ee-8c4b-c902f6b89ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2a619cf2-d932-4d4a-8ef4-d5b14693e08b tempest-VolumesActionsTest-1346416954 None] Created volume successfully. Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Flow 'volume_create_manager' (39d02904-626d-4967-90bf-7eaa79614a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4276900e-f286-471d-a9ba-4173dd13dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4276900e-f286-471d-a9ba-4173dd13dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1184011263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8450194d-99b4-4574-a8dc-1744735e0f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6e1493c1e5403aab8eaf5a63560691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9df59abe-49dc-4374-bba4-6e2dd7f16de7,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:48Z,use_quota=True,user_id='83a659c88d7e4ae2b1eae4519f73a2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c142c-48e9-4041-98d9-db3d38e5602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c142c-48e9-4041-98d9-db3d38e5602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23af1f3-8c4f-4866-85c7-73daea687bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23af1f3-8c4f-4866-85c7-73daea687bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8450194d-99b4-4574-a8dc-1744735e0f2a', 'volume_name': 'volume-8450194d-99b4-4574-a8dc-1744735e0f2a', 'volume_size': 2, 'source_volid': '9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'source_volstatus': 'available'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b114b-7c9b-4768-9bd9-b9670a783c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b114b-7c9b-4768-9bd9-b9670a783c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d82afa-6fe8-4ea5-a456-9b94429a8035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Volume 8450194d-99b4-4574-a8dc-1744735e0f2a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8450194d-99b4-4574-a8dc-1744735e0f2a', 'volume_size': 2, 'source_volid': '9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'source_volstatus': 'available'} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:48 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Cloning volume 9df59abe-49dc-4374-bba4-6e2dd7f16de7 to volume 8450194d-99b4-4574-a8dc-1744735e0f2a Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Creating offline snapshot 8ed58130-b42a-4076-89b1-61504a77e526 of volume 9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c880b6-98bc-49cf-8c58-6c2d2c063b4c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:48 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:27:48 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:48 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.466s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:48 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 1G Jul 23 03:27:48 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 1G" returned: 0 in 0.678s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:49 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:27:49 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:49 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 is being set with open permissions: ugo+rw Jul 23 03:27:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:49 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:27:49 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.574s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info Jul 23 03:27:50 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info" returned: 0 in 0.391s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info is being set with open permissions: ugo+rw Jul 23 03:27:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info Jul 23 03:27:50 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:51 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.info" returned: 0 in 0.384s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] snapshot: 8ed58130-b42a-4076-89b1-61504a77e526, volume: 8450194d-99b4-4574-a8dc-1744735e0f2a, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce52f03-5136-4281-8f74-bb14b69fd99d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:51 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:27:51 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Flow 'volume_create_manager' (800a6b58-315c-4118-90e3-c4c2f8a6da33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aa3598-cb3e-4c8c-af55-b44ef96a0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:52 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aa3598-cb3e-4c8c-af55-b44ef96a0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1046341959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa95f56-13cd-476e-b842-cd7ff2a7a316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7601cd405584659ab76d5e40dd1a1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:52Z,use_quota=True,user_id='be84862c27bc4a60a0b807cec474efe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c0ff9-2897-4a82-bc96-0b8aba1bff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c0ff9-2897-4a82-bc96-0b8aba1bff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f86bc1-dc1f-4b04-b49c-5a72c6aaff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f86bc1-dc1f-4b04-b49c-5a72c6aaff63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa95f56-13cd-476e-b842-cd7ff2a7a316', 'volume_name': 'volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04778471-e842-4e89-86b6-24f18732dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04778471-e842-4e89-86b6-24f18732dc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95cba18-a83f-42cc-a6a7-d06d08097231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:52 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Volume ffa95f56-13cd-476e-b842-cd7ff2a7a316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316', 'volume_size': 1} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.789s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51c0f4-5115-4428-8f30-f006644d3241]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:52 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:27:52 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.506s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:27:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:52 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a Jul 23 03:27:52 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:59 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a" returned: 0 in 6.623s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1fdd09-82fc-4c60-84bb-1fb9a5ff1e55]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:59 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:27:59 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:00 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 1.145s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:00 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Converted 1024.00 MB image at 154.52 MB/s Jul 23 03:28:00 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a is being set with open permissions: ugo+rw Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:00 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a Jul 23 03:28:00 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:00 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" released by "_copy_volume_from_snapshot" :: held 9.583s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-quobyte-8ed58130-b42a-4076-89b1-61504a77e526" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8ed58130-b42a-4076-89b1-61504a77e526" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Deleting offline snapshot 8ed58130-b42a-4076-89b1-61504a77e526 of volume 9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] snapshot_file for this snap is: volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4628047-11e7-4aad-a554-4a042d440761]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:28:01 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.456s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0784e-7868-4e4a-98c6-adc50576acdd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:28:01 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:02 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:INSERT=34,cinder:UPDATE=143,cinder:SELECT=100,cinder:DELETE=11 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:02 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:02 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:28:02 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:02 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:02 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526 Jul 23 03:28:02 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7.8ed58130-b42a-4076-89b1-61504a77e526" returned: 0 in 0.395s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8ed58130-b42a-4076-89b1-61504a77e526" released by "_delete_snapshot" :: held 2.151s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.970s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1046341959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa95f56-13cd-476e-b842-cd7ff2a7a316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7601cd405584659ab76d5e40dd1a1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:52Z,use_quota=True,user_id='be84862c27bc4a60a0b807cec474efe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Creating volume ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:03 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d82afa-6fe8-4ea5-a456-9b94429a8035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8450194d-99b4-4574-a8dc-1744735e0f2a', 'volume_size': 2, 'source_volid': '9df59abe-49dc-4374-bba4-6e2dd7f16de7', 'source_volstatus': 'available'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:03 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 1073741824 Jul 23 03:28:03 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638eba55-faba-438f-992a-13a320cfbeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:03 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Volume volume-8450194d-99b4-4574-a8dc-1744735e0f2a (8450194d-99b4-4574-a8dc-1744735e0f2a): created successfully Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638eba55-faba-438f-992a-13a320cfbeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Flow 'volume_create_manager' (39d02904-626d-4967-90bf-7eaa79614a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f88b7ffb-f607-4281-aad8-e4a0105de873 tempest-VolumesCloneTest-1832499474 None] Created volume successfully. Jul 23 03:28:03 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 1073741824" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 Jul 23 03:28:03 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2ab3c3b9-5099-4d70-8e08-7b5a3341124f tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" by "attach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2ab3c3b9-5099-4d70-8e08-7b5a3341124f tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" acquired by "attach_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-8450194d-99b4-4574-a8dc-1744735e0f2a-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316" returned: 0 in 0.539s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-8450194d-99b4-4574-a8dc-1744735e0f2a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95cba18-a83f-42cc-a6a7-d06d08097231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9d4df4-f821-4460-80c1-cfa7a1d2ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:04 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Volume volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 (ffa95f56-13cd-476e-b842-cd7ff2a7a316): created successfully Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9d4df4-f821-4460-80c1-cfa7a1d2ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Flow 'volume_create_manager' (800a6b58-315c-4118-90e3-c4c2f8a6da33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-50ed7da1-3117-4ef6-b9c6-3956601a80ac tempest-SnapshotMetadataTestJSON-1973566079 None] Created volume successfully. Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2ab3c3b9-5099-4d70-8e08-7b5a3341124f tempest-VolumesActionsTest-1346416954 None] Attaching volume b689a8ec-670f-4fba-b886-a89c12625338 to instance d4490939-0a83-4116-a5da-66d5cd7ffbe7 at mountpoint /dev/vdb on host None. Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" acquired by "delete_volume" :: waited 0.063s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2ab3c3b9-5099-4d70-8e08-7b5a3341124f tempest-VolumesActionsTest-1346416954 None] Attach volume completed successfully. Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2ab3c3b9-5099-4d70-8e08-7b5a3341124f tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" released by "attach_volume" :: held 0.417s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d07560-90ee-48a1-a9cd-34094efac143]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:04 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a Jul 23 03:28:04 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a8405e7-f4e0-4aae-98b1-d31f9e245c88 tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" by "detach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a8405e7-f4e0-4aae-98b1-d31f9e245c88 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1a8405e7-f4e0-4aae-98b1-d31f9e245c88 tempest-VolumesActionsTest-1346416954 None] Detaching volume b689a8ec-670f-4fba-b886-a89c12625338 from instance d4490939-0a83-4116-a5da-66d5cd7ffbe7. Jul 23 03:28:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1a8405e7-f4e0-4aae-98b1-d31f9e245c88 tempest-VolumesActionsTest-1346416954 None] Detach volume completed successfully. Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1a8405e7-f4e0-4aae-98b1-d31f9e245c88 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:05 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a" returned: 0 in 0.588s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a Jul 23 03:28:05 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8450194d-99b4-4574-a8dc-1744735e0f2a" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-8450194d-99b4-4574-a8dc-1744735e0f2a" released by "delete_volume" :: held 1.046s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Created reservations ['bdb21f2b-5ef7-4f01-a7b3-668452d7d1a7', '4659ff3b-37a3-4116-a662-d3aa8a069f57', 'fe4bc371-4963-49f0-b14d-9bb95eeab719', 'c2f95772-0e9c-4d82-b1b7-bfd45af27bd6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:05 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Creating offline snapshot 5782bbb8-ad5f-4e94-8a64-a13486778d7e of volume ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7ff57b-4906-43fd-8155-6d52e3be8063]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.423s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Deleted volume successfully. Jul 23 03:28:06 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 Jul 23 03:28:06 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-899897b1-d118-40b0-8b05-1cdc95189388 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-8450194d-99b4-4574-a8dc-1744735e0f2a-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:06 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316" returned: 0 in 0.610s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e 1G Jul 23 03:28:06 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-9df59abe-49dc-4374-bba4-6e2dd7f16de7-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-9df59abe-49dc-4374-bba4-6e2dd7f16de7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "cinder-quobyte-9df59abe-49dc-4374-bba4-6e2dd7f16de7" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-9df59abe-49dc-4374-bba4-6e2dd7f16de7" acquired by "delete_volume" :: waited 0.048s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Flow 'volume_create_manager' (4cf7df5e-e02c-4e78-9784-ad7b2199d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93afa7c-533c-435f-b511-802b3f1e417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d9c64-8f10-4941-ab79-17f68f97c3f2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93afa7c-533c-435f-b511-802b3f1e417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2011247329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf35a4f-e725-47d6-9e18-d8908c25a1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e851391a74477d9c3b764a2ef9bb1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:07Z,use_quota=True,user_id='fedf98acff6a4f12bbd877bc0915b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09814ac7-5e24-46a6-8b09-2cc9f2dabde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09814ac7-5e24-46a6-8b09-2cc9f2dabde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dd5597-d94f-4baf-93aa-7b93b46069f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dd5597-d94f-4baf-93aa-7b93b46069f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf35a4f-e725-47d6-9e18-d8908c25a1d2', 'volume_name': 'volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9e603a-e1c8-4762-b8f5-349199e9c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9e603a-e1c8-4762-b8f5-349199e9c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47a2ef4-a644-47f3-83aa-abe4a6c76fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Volume eaf35a4f-e725-47d6-9e18-d8908c25a1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2', 'volume_size': 1} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:07 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:28:07 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e 1G" returned: 0 in 0.772s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e Jul 23 03:28:07 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.494s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7 Jul 23 03:28:07 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e" returned: 0 in 0.399s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e is being set with open permissions: ugo+rw Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e Jul 23 03:28:07 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9df59abe-49dc-4374-bba4-6e2dd7f16de7" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-quobyte-9df59abe-49dc-4374-bba4-6e2dd7f16de7" released by "delete_volume" :: held 0.944s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Created reservations ['73fae1c1-c89f-483e-a9a3-36b234346ee3', 'd2433d7b-45e4-4e56-84ca-793470129c12', '6ccd4878-9146-4449-81ae-bc4a135f3baa', 'e14c3cf2-e6d8-4afc-9e95-9b48d5fb267b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:08 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e" returned: 0 in 0.297s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info Jul 23 03:28:08 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Deleted volume successfully. Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73a9b60f-43c3-4f33-8192-b8830ec52ec0 tempest-VolumesCloneTest-1832499474 None] Lock "cinder-9df59abe-49dc-4374-bba4-6e2dd7f16de7-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:08 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:08 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info is being set with open permissions: ugo+rw Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info Jul 23 03:28:08 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.info" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2011247329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf35a4f-e725-47d6-9e18-d8908c25a1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e851391a74477d9c3b764a2ef9bb1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:07Z,use_quota=True,user_id='fedf98acff6a4f12bbd877bc0915b867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Creating volume eaf35a4f-e725-47d6-9e18-d8908c25a1d2 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:08 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 1073741824 Jul 23 03:28:08 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e9190336-77d3-46e5-b434-a6ab3d20b2dc tempest-SnapshotMetadataTestJSON-1973566079 None] Create snapshot completed successfully Jul 23 03:28:09 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 1073741824" returned: 0 in 0.613s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:09 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 Jul 23 03:28:09 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:09 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47a2ef4-a644-47f3-83aa-abe4a6c76fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dbebe5-91a0-4668-8781-93b4a6aea523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:09 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Volume volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 (eaf35a4f-e725-47d6-9e18-d8908c25a1d2): created successfully Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dbebe5-91a0-4668-8781-93b4a6aea523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Flow 'volume_create_manager' (4cf7df5e-e02c-4e78-9784-ad7b2199d131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9dd67aee-122b-461f-bb0e-2163307cf374 tempest-AbsoluteLimitsTests-2092641653 None] Created volume successfully. Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Acquiring lock "cinder-eaf35a4f-e725-47d6-9e18-d8908c25a1d2-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "cinder-eaf35a4f-e725-47d6-9e18-d8908c25a1d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Acquiring lock "cinder-quobyte-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "cinder-5782bbb8-ad5f-4e94-8a64-a13486778d7e-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "cinder-quobyte-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" acquired by "delete_volume" :: waited 0.069s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-5782bbb8-ad5f-4e94-8a64-a13486778d7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f66fb-7236-40aa-b747-92c9c6fa3048]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "cinder-quobyte-5782bbb8-ad5f-4e94-8a64-a13486778d7e" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-5782bbb8-ad5f-4e94-8a64-a13486778d7e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Deleting offline snapshot 5782bbb8-ad5f-4e94-8a64-a13486778d7e of volume ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] snapshot_file for this snap is: volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e18fb4-399e-453c-b068-52eb65ac0b37]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:10 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 Jul 23 03:28:10 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:10 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e Jul 23 03:28:10 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" returned: 0 in 0.562s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2 Jul 23 03:28:11 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e" returned: 0 in 0.673s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6192c198-cb50-4357-b6ca-347461e87e4b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" returned: 0 in 0.448s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 Jul 23 03:28:11 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "cinder-quobyte-eaf35a4f-e725-47d6-9e18-d8908c25a1d2" released by "delete_volume" :: held 1.097s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Created reservations ['c6b67f0b-d9cb-4699-ac91-65bfe246bf9c', '41ffef22-a3e4-40a1-83c1-e60f80d57e35', 'a9a2dc37-b8af-4daa-a03e-79d5013cc597', '78fff2e9-7815-46c1-aa26-04e321ec6195'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:11 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316" returned: 0 in 0.548s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e Jul 23 03:28:11 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.527s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Deleted volume successfully. Jul 23 03:28:12 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-77eef7e5-7ae7-49f6-b6c7-9a8e7284b357 tempest-AbsoluteLimitsTests-2092641653 None] Lock "cinder-eaf35a4f-e725-47d6-9e18-d8908c25a1d2-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:12 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e" returned: 0 in 0.629s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:12 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e Jul 23 03:28:12 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:12 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316.5782bbb8-ad5f-4e94-8a64-a13486778d7e" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-5782bbb8-ad5f-4e94-8a64-a13486778d7e" released by "_delete_snapshot" :: held 2.358s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" released by "delete_snapshot" :: held 2.391s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Created reservations ['111d885c-6241-49d4-a651-6d0b5eb4a114', '05cf20c4-9ebe-4fe7-aff0-5e0cd9389be2', 'd3390a7b-246c-48fe-80e2-9f24e440cc45', '7e564461-cea7-427c-8697-64eebef99665'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Delete snapshot completed successfully. Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bae0715d-28ed-4fa4-b1a8-21ff0e3f8893 tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-5782bbb8-ad5f-4e94-8a64-a13486778d7e-delete_snapshot" released by "delete_snapshot" :: held 2.597s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "cinder-ffa95f56-13cd-476e-b842-cd7ff2a7a316-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-ffa95f56-13cd-476e-b842-cd7ff2a7a316-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Flow 'volume_create_manager' (bc2d28d2-9ca2-4188-a332-026a63714567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f20b82-0725-42cf-8b66-7535948e7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f20b82-0725-42cf-8b66-7535948e7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-661072028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f4cb9-b274-4430-8384-9655b7737774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d7ce28872a4d6fbfb22db98d141381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:14Z,use_quota=True,user_id='77edb360c25943be9a2631e2c781a314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c099ecec-3f47-4b95-9776-4eaf3b5660f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c099ecec-3f47-4b95-9776-4eaf3b5660f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e5cb66-8737-480c-bc01-dcfd6c50b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e5cb66-8737-480c-bc01-dcfd6c50b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5f4cb9-b274-4430-8384-9655b7737774', 'volume_name': 'volume-eb5f4cb9-b274-4430-8384-9655b7737774', 'volume_size': 2}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ded2ef1-5189-445d-a2b3-05361e9ee07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ded2ef1-5189-445d-a2b3-05361e9ee07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9efd3b-d856-4936-99ec-925307bc69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Volume eb5f4cb9-b274-4430-8384-9655b7737774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5f4cb9-b274-4430-8384-9655b7737774', 'volume_size': 2} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-661072028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f4cb9-b274-4430-8384-9655b7737774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d7ce28872a4d6fbfb22db98d141381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:14Z,use_quota=True,user_id='77edb360c25943be9a2631e2c781a314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Creating volume eb5f4cb9-b274-4430-8384-9655b7737774 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:14 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 2147483648 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:14 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 2147483648 Jul 23 03:28:14 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d4ff0-e03a-4b48-a630-98d8f3fcf711]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:14 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 Jul 23 03:28:14 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:14 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316" returned: 0 in 0.492s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:14 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316 Jul 23 03:28:14 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:14 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 2147483648" returned: 0 in 0.821s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 Jul 23 03:28:15 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:15 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ffa95f56-13cd-476e-b842-cd7ff2a7a316" returned: 0 in 0.518s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-quobyte-ffa95f56-13cd-476e-b842-cd7ff2a7a316" released by "delete_volume" :: held 1.139s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Created reservations ['dd2b8755-6fe8-4d71-916d-7767b141470a', '7fdbd00a-702d-4f16-b060-e34ebcf74ba1', 'f1d43e5b-5f20-4e7d-8138-f5a2e5714463', 'e1eae57f-1d78-4d3c-ae0a-fd49682f3861'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:15 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774" returned: 0 in 0.643s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:15 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:15 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9efd3b-d856-4936-99ec-925307bc69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5f4cb9-b274-4430-8384-9655b7737774', 'volume_size': 2}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f2a9f2-486e-4df2-8a0c-b7b8d3435960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Volume volume-eb5f4cb9-b274-4430-8384-9655b7737774 (eb5f4cb9-b274-4430-8384-9655b7737774): created successfully Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f2a9f2-486e-4df2-8a0c-b7b8d3435960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Flow 'volume_create_manager' (bc2d28d2-9ca2-4188-a332-026a63714567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-938fca56-aeb1-4df5-b96a-34cc3d1b2b84 tempest-VolumesCloneNegativeTest-625605536 None] Created volume successfully. Jul 23 03:28:16 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Deleted volume successfully. Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a573c3e3-bc27-4f87-9702-d810430caa3e tempest-SnapshotMetadataTestJSON-1973566079 None] Lock "cinder-ffa95f56-13cd-476e-b842-cd7ff2a7a316-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Acquiring lock "cinder-eb5f4cb9-b274-4430-8384-9655b7737774-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "cinder-eb5f4cb9-b274-4430-8384-9655b7737774-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Acquiring lock "cinder-quobyte-eb5f4cb9-b274-4430-8384-9655b7737774" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "cinder-quobyte-eb5f4cb9-b274-4430-8384-9655b7737774" acquired by "delete_volume" :: waited 0.037s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a013af-6780-492a-a76a-92137176d22e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:17 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 Jul 23 03:28:17 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:17 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774" returned: 0 in 0.601s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:17 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774 Jul 23 03:28:17 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:18 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-eb5f4cb9-b274-4430-8384-9655b7737774" returned: 0 in 0.546s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "cinder-quobyte-eb5f4cb9-b274-4430-8384-9655b7737774" released by "delete_volume" :: held 1.251s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Created reservations ['30ecb707-60cf-471c-a938-bb9c18a92b91', '0178c66a-bb48-40d2-9079-a1a9a06b5673', '7a3bc03a-7d50-4fee-946b-e2c903d88ea6', '4cd9899e-a92c-4f9c-b70c-e8aacc84c4f2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:18 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:18 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:18 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.455s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Deleted volume successfully. Jul 23 03:28:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8f3323da-dd95-44e5-8e68-c0ed0ec58ce2 tempest-VolumesCloneNegativeTest-625605536 None] Lock "cinder-eb5f4cb9-b274-4430-8384-9655b7737774-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0da8d785-ff67-4628-b6ef-d8e0b7f6c7ef tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" by "attach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0da8d785-ff67-4628-b6ef-d8e0b7f6c7ef tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" acquired by "attach_volume" :: waited 0.044s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0da8d785-ff67-4628-b6ef-d8e0b7f6c7ef tempest-VolumesActionsTest-1346416954 None] Attaching volume b689a8ec-670f-4fba-b886-a89c12625338 to instance 0f027332-8f80-4cf5-bbc5-2b76e1fbef27 at mountpoint /dev/vdb on host None. Jul 23 03:28:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0da8d785-ff67-4628-b6ef-d8e0b7f6c7ef tempest-VolumesActionsTest-1346416954 None] Attach volume completed successfully. Jul 23 03:28:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0da8d785-ff67-4628-b6ef-d8e0b7f6c7ef tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338" released by "attach_volume" :: held 0.181s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-08c50e80-cdd0-4c91-8f77-f2abfa771643 tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" by "detach_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-08c50e80-cdd0-4c91-8f77-f2abfa771643 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-08c50e80-cdd0-4c91-8f77-f2abfa771643 tempest-VolumesActionsTest-1346416954 None] Detaching volume b689a8ec-670f-4fba-b886-a89c12625338 from instance 0f027332-8f80-4cf5-bbc5-2b76e1fbef27. Jul 23 03:28:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-08c50e80-cdd0-4c91-8f77-f2abfa771643 tempest-VolumesActionsTest-1346416954 None] Detach volume completed successfully. Jul 23 03:28:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-08c50e80-cdd0-4c91-8f77-f2abfa771643 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Flow 'volume_create_manager' (a3aff98b-8123-498f-9856-9f10575f16bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079bf7d0-abe5-43e1-80b7-a2c41f4ef4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079bf7d0-abe5-43e1-80b7-a2c41f4ef4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-851749997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34722719-8830-42dd-8e41-edf9636bb0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1627fa5883437298a17bd66d319365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:25Z,use_quota=True,user_id='3c95d9112b47485ba73f651311a7599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f80084-487f-4f17-a618-48a720829768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f80084-487f-4f17-a618-48a720829768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c31b1e-c118-4167-917d-48e5ee770ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Flow 'volume_create_manager' (76e543ce-1f09-4f16-b512-92996b128ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc962b93-ba7b-4a3e-ab2c-bf1a9a836117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc962b93-ba7b-4a3e-ab2c-bf1a9a836117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1453341869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0271f61-5958-4158-8316-236499bfd500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678fa90d382e498991197984a6e22fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:26Z,use_quota=True,user_id='19b9309d294b4b4c9e41c634357edd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d15520-e6b5-4466-9240-508164389b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d15520-e6b5-4466-9240-508164389b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af639f97-5843-4686-b746-48db551c2048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af639f97-5843-4686-b746-48db551c2048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0271f61-5958-4158-8316-236499bfd500', 'volume_name': 'volume-c0271f61-5958-4158-8316-236499bfd500', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44626538-1192-4d08-8855-8ec724ee3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44626538-1192-4d08-8855-8ec724ee3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a453894d-c9e4-4e13-8523-dcdc8ac63009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:25 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Volume c0271f61-5958-4158-8316-236499bfd500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0271f61-5958-4158-8316-236499bfd500', 'volume_size': 1} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1453341869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0271f61-5958-4158-8316-236499bfd500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678fa90d382e498991197984a6e22fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:26Z,use_quota=True,user_id='19b9309d294b4b4c9e41c634357edd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Creating volume c0271f61-5958-4158-8316-236499bfd500 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:25 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:25 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 1073741824 Jul 23 03:28:25 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c31b1e-c118-4167-917d-48e5ee770ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34722719-8830-42dd-8e41-edf9636bb0a1', 'volume_name': 'volume-34722719-8830-42dd-8e41-edf9636bb0a1', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58b83cc-d2db-4a90-9142-5c00fbd97f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58b83cc-d2db-4a90-9142-5c00fbd97f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae397a7a-ffd7-41ea-acc6-b0beb5dc2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:26 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Volume 34722719-8830-42dd-8e41-edf9636bb0a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34722719-8830-42dd-8e41-edf9636bb0a1', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Trying to clone 34722719-8830-42dd-8e41-edf9636bb0a1 from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 at location (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:28:26 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 1073741824" returned: 0 in 0.724s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:26 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 Jul 23 03:28:26 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:26 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:28:26 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c99747-da64-4264-bc66-9ab64f30f0ea]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:27 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500" returned: 0 in 0.317s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a453894d-c9e4-4e13-8523-dcdc8ac63009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0271f61-5958-4158-8316-236499bfd500', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bedb56e-ed05-48c0-b1f0-a25c50b4600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Volume volume-c0271f61-5958-4158-8316-236499bfd500 (c0271f61-5958-4158-8316-236499bfd500): created successfully Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bedb56e-ed05-48c0-b1f0-a25c50b4600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Flow 'volume_create_manager' (76e543ce-1f09-4f16-b512-92996b128ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e8443f1a-35f2-439f-ba00-636e4c479dde tempest-VolumesTransfersV355Test-1128271628 None] Created volume successfully. Jul 23 03:28:27 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD Jul 23 03:28:27 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (fdf45648-fdb3-41a4-be13-4a34099bb7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce8d364-32db-4139-abf5-9615b82ac27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce8d364-32db-4139-abf5-9615b82ac27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1398965773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538f4989-f942-4343-ad14-d2dd70f4cf81,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:27Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd74bbb8-b840-42b7-9761-7fc3e01276de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd74bbb8-b840-42b7-9761-7fc3e01276de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1a0f9d-9e63-4d1b-9acf-424b49de3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1a0f9d-9e63-4d1b-9acf-424b49de3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538f4989-f942-4343-ad14-d2dd70f4cf81', 'volume_name': 'volume-538f4989-f942-4343-ad14-d2dd70f4cf81', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f07d657-c147-449d-9519-1f0d92362074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f07d657-c147-449d-9519-1f0d92362074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95142159-ca0a-45ef-87a4-d83d336d8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Volume 538f4989-f942-4343-ad14-d2dd70f4cf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538f4989-f942-4343-ad14-d2dd70f4cf81', 'volume_size': 1} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1398965773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538f4989-f942-4343-ad14-d2dd70f4cf81,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:27Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Creating volume 538f4989-f942-4343-ad14-d2dd70f4cf81 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:27 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:27 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 is fetched for user 3c95d9112b47485ba73f651311a7599c. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:28:27 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 1073741824 Jul 23 03:28:27 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb204f6-9d4b-448c-a122-e1534497e13b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:27 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD Jul 23 03:28:27 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:28 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:28 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 1073741824" returned: 0 in 0.584s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-27bbe012-be4f-4155-9df4-a99f7065f5d0 tempest-VolumesTransfersV355Test-482953456 None] Transfer volume completed successfully. Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:28 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 Jul 23 03:28:28 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:28 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.865s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95142159-ca0a-45ef-87a4-d83d336d8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538f4989-f942-4343-ad14-d2dd70f4cf81', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e6e725-0863-45a2-a17b-0480941284f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[154fb1c2-078f-47c4-bb84-91cdde431740]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Volume volume-538f4989-f942-4343-ad14-d2dd70f4cf81 (538f4989-f942-4343-ad14-d2dd70f4cf81): created successfully Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e6e725-0863-45a2-a17b-0480941284f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (fdf45648-fdb3-41a4-be13-4a34099bb7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4548f8a7-9027-4693-8e53-84917fbc3eb3 tempest-VolumesListTestJSON-869240452 None] Created volume successfully. Jul 23 03:28:28 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:28:28 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "cinder-c0271f61-5958-4158-8316-236499bfd500-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-c0271f61-5958-4158-8316-236499bfd500-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "cinder-quobyte-c0271f61-5958-4158-8316-236499bfd500" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-quobyte-c0271f61-5958-4158-8316-236499bfd500" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8a8a80-50dc-43af-a685-0eb0b7f689aa]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.435s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[87864524-c9bf-4a39-a494-ee0fbf83de3d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 Jul 23 03:28:29 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:28:29 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500 Jul 23 03:28:29 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.428s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.cb1bdb9d-e2a9-4293-94aa-d2eb21453a3ai4555217.img {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.cb1bdb9d-e2a9-4293-94aa-d2eb21453a3ai4555217.img Jul 23 03:28:29 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0271f61-5958-4158-8316-236499bfd500" returned: 0 in 0.275s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-quobyte-c0271f61-5958-4158-8316-236499bfd500" released by "delete_volume" :: held 0.716s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Created reservations ['ee953f52-5483-49d1-9cb9-d996a8610bb1', '91a8ff0c-ccb5-4e38-9b22-6f6e30ab2463', 'cfe47f90-1981-463d-870e-a8287b09c8d7', 'f83c906a-3750-4fa4-bb8c-52fba078ec4b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:29 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:30 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.879s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Deleted volume successfully. Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e535b636-8445-4707-8876-72de18733f63 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-c0271f61-5958-4158-8316-236499bfd500-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (bcce3a64-bdec-4eab-83ef-9db01ae2d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e96f46-39a1-4295-8bee-2d6182194671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e96f46-39a1-4295-8bee-2d6182194671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1879765544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f48a80-5c2e-491f-b67f-365f75c86c4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:31Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0756e5-f5eb-4fe1-9e29-2dedf409e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0756e5-f5eb-4fe1-9e29-2dedf409e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180976ae-57c6-4e04-b318-e599d6dece09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180976ae-57c6-4e04-b318-e599d6dece09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f48a80-5c2e-491f-b67f-365f75c86c4e', 'volume_name': 'volume-15f48a80-5c2e-491f-b67f-365f75c86c4e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085e933e-0ffe-4c8c-a60c-e1381b02bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085e933e-0ffe-4c8c-a60c-e1381b02bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8ee65-354c-4817-a51f-438754647934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Volume 15f48a80-5c2e-491f-b67f-365f75c86c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f48a80-5c2e-491f-b67f-365f75c86c4e', 'volume_size': 1} Jul 23 03:28:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:31 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Flow 'volume_create_manager' (080d59bf-0534-452b-b89c-8c3c92cd9392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e6466-1923-44ae-aba6-e4abf050575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e6466-1923-44ae-aba6-e4abf050575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059354356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad155419-5b71-4c2f-b65e-5432ab07b867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678fa90d382e498991197984a6e22fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:32Z,use_quota=True,user_id='19b9309d294b4b4c9e41c634357edd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c84d2-3cff-4203-b652-14bde21dbe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c84d2-3cff-4203-b652-14bde21dbe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52df9b7-3d18-4d29-8c05-97bfabc98977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52df9b7-3d18-4d29-8c05-97bfabc98977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad155419-5b71-4c2f-b65e-5432ab07b867', 'volume_name': 'volume-ad155419-5b71-4c2f-b65e-5432ab07b867', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310ce90c-0e30-4165-991b-0fb3d8595ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310ce90c-0e30-4165-991b-0fb3d8595ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9eb2f7-8c56-493e-84d8-f5b549b8280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Volume ad155419-5b71-4c2f-b65e-5432ab07b867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad155419-5b71-4c2f-b65e-5432ab07b867', 'volume_size': 1} Jul 23 03:28:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:34 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.cb1bdb9d-e2a9-4293-94aa-d2eb21453a3ai4555217.img" returned: 0 in 4.969s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc664cc0-f1cc-4078-8d30-8b212bfed5da]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:34 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:28:34 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:34 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.524s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.cb1bdb9d-e2a9-4293-94aa-d2eb21453a3ai4555217.img {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:34 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Converted 1024.00 MB image at 206.04 MB/s Jul 23 03:28:34 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] cb1bdb9d-e2a9-4293-94aa-d2eb21453a3a was raw, no need to convert to raw {{(pid=88044) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:35 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:36 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.275s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:28:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:28:42 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=119,cinder:SELECT=94,cinder:INSERT=31,cinder:DELETE=12 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:44 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=85,cinder:SELECT=74,cinder:INSERT=20,cinder:DELETE=4 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.429s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Uploaded volume to glance image-id: cb1bdb9d-e2a9-4293-94aa-d2eb21453a3a. {{(pid=88044) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.826s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-851749997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34722719-8830-42dd-8e41-edf9636bb0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1627fa5883437298a17bd66d319365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:25Z,use_quota=True,user_id='3c95d9112b47485ba73f651311a7599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Creating volume 34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:53 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1073741824 Jul 23 03:28:53 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-97edffb8-0892-4efe-b665-dd0a3498a5ce tempest-VolumesActionsTest-1346416954 None] Copy volume to image completed successfully. Jul 23 03:28:54 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1073741824" returned: 0 in 0.436s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 Jul 23 03:28:54 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:54 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.712s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1879765544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f48a80-5c2e-491f-b67f-365f75c86c4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:31Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Creating volume 15f48a80-5c2e-491f-b67f-365f75c86c4e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:54 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e 1073741824 Jul 23 03:28:54 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Attempting download of 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 34722719-8830-42dd-8e41-edf9636bb0a1. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba8998-f218-44e1-acf0-6aa484631f04]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6 Jul 23 03:28:54 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e 1073741824" returned: 0 in 0.541s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6 Jul 23 03:28:55 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e Jul 23 03:28:55 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6" returned: 1 in 0.373s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_f2_e8wr6' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3101c7-ae05-4053-9af0-f016af3070b2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.457s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059354356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad155419-5b71-4c2f-b65e-5432ab07b867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678fa90d382e498991197984a6e22fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:32Z,use_quota=True,user_id='19b9309d294b4b4c9e41c634357edd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Creating volume ad155419-5b71-4c2f-b65e-5432ab07b867 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:55 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8ee65-354c-4817-a51f-438754647934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f48a80-5c2e-491f-b67f-365f75c86c4e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:55 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 1073741824 Jul 23 03:28:55 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c339c83-5eb6-4ee7-9066-dbc5393138e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:55 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Volume volume-15f48a80-5c2e-491f-b67f-365f75c86c4e (15f48a80-5c2e-491f-b67f-365f75c86c4e): created successfully Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c339c83-5eb6-4ee7-9066-dbc5393138e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (bcce3a64-bdec-4eab-83ef-9db01ae2d074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7b27712b-3176-439e-8614-9e5cf86a9f2c tempest-VolumesListTestJSON-869240452 None] Created volume successfully. Jul 23 03:28:55 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD Jul 23 03:28:55 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] 305f1036-a296-4b7a-ad9a-5bff6ecc6243 was qcow2, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:28:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 Jul 23 03:28:56 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:56 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 1073741824" returned: 0 in 0.530s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 Jul 23 03:28:56 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:56 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867" returned: 0 in 0.305s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.503s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb56a23-c87a-4b1b-be70-9a675f838915]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9eb2f7-8c56-493e-84d8-f5b549b8280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad155419-5b71-4c2f-b65e-5432ab07b867', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a131dac-c588-480c-951a-04b1eba173e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:56 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Volume volume-ad155419-5b71-4c2f-b65e-5432ab07b867 (ad155419-5b71-4c2f-b65e-5432ab07b867): created successfully Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a131dac-c588-480c-951a-04b1eba173e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Flow 'volume_create_manager' (080d59bf-0534-452b-b89c-8c3c92cd9392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0aaa5430-5bbd-45ea-8399-46a7fe60ad64 tempest-VolumesTransfersV355Test-1128271628 None] Created volume successfully. Jul 23 03:28:56 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:28:56 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (2ac6ce20-79a6-422a-a15e-65bd35ca3af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:57 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e88a97-5731-4553-b81a-cff4a92c10f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.511s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e88a97-5731-4553-b81a-cff4a92c10f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155003046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d31e65c-9078-45de-afec-fd007f33fed4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:57Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b38888-2ae3-4a80-8578-f3fc6cda4ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b38888-2ae3-4a80-8578-f3fc6cda4ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c30fb08-db3c-4c55-811e-0862f6a05d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c30fb08-db3c-4c55-811e-0862f6a05d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d31e65c-9078-45de-afec-fd007f33fed4', 'volume_name': 'volume-3d31e65c-9078-45de-afec-fd007f33fed4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22663fc-8453-4dc1-a84b-1aabb44c3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22663fc-8453-4dc1-a84b-1aabb44c3659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edb7d52-f96b-44a4-bfa7-88307b98598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:57 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Volume 3d31e65c-9078-45de-afec-fd007f33fed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d31e65c-9078-45de-afec-fd007f33fed4', 'volume_size': 1} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc44b6-e1c7-4521-81c2-e69ff3730072]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:28:57 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.504s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "cinder-ad155419-5b71-4c2f-b65e-5432ab07b867-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-ad155419-5b71-4c2f-b65e-5432ab07b867-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:57 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img Jul 23 03:28:57 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "cinder-quobyte-ad155419-5b71-4c2f-b65e-5432ab07b867" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-quobyte-ad155419-5b71-4c2f-b65e-5432ab07b867" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac433d-4477-4184-8685-afc226a20a89]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 Jul 23 03:28:57 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:58 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867" returned: 0 in 0.553s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:58 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:58 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867 Jul 23 03:28:58 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1" returned: 0 in 2.556s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:58 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243__qbdqp_tdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:58 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Converted 112.00 MB image at 43.72 MB/s Jul 23 03:28:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:58 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1G Jul 23 03:28:58 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:59 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ad155419-5b71-4c2f-b65e-5432ab07b867" returned: 0 in 0.718s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-quobyte-ad155419-5b71-4c2f-b65e-5432ab07b867" released by "delete_volume" :: held 1.357s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Created reservations ['1a9e713c-76bc-4f5d-99d9-2aafa25fca38', '0bd7b1a2-dc35-4af3-a9cf-c97874489d0c', '7d50a590-e67f-42e1-ab31-8a9227c076fe', '0856e316-9213-4725-90c9-4702dfe2a3c6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:59 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 1G" returned: 0 in 0.921s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Downloaded image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 34722719-8830-42dd-8e41-edf9636bb0a1 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 for user 3c95d9112b47485ba73f651311a7599c is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Marking volume 34722719-8830-42dd-8e41-edf9636bb0a1 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Copying metadata from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 to 34722719-8830-42dd-8e41-edf9636bb0a1. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Creating volume glance metadata for volume 34722719-8830-42dd-8e41-edf9636bb0a1 backed by image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:59 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:28:59 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae397a7a-ffd7-41ea-acc6-b0beb5dc2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34722719-8830-42dd-8e41-edf9636bb0a1', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2f8f32-f221-4c69-8359-56300a278b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:59 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Volume volume-34722719-8830-42dd-8e41-edf9636bb0a1 (34722719-8830-42dd-8e41-edf9636bb0a1): created successfully Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2f8f32-f221-4c69-8359-56300a278b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:59 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Flow 'volume_create_manager' (a3aff98b-8123-498f-9856-9f10575f16bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-be86a25d-cdb1-4fed-a3d4-e6e691502e5d tempest-VolumesExtendTest-1807169319 None] Created volume successfully. Jul 23 03:29:00 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.893s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:00 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Deleted volume successfully. Jul 23 03:29:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e48b6862-3d2c-46f5-a108-226f99744198 tempest-VolumesTransfersV355Test-589726342 None] Lock "cinder-ad155419-5b71-4c2f-b65e-5432ab07b867-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:03 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img" returned: 0 in 5.474s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9680bd5-da01-4433-8054-155007f5b452]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:03 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:29:03 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:03 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.611s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:03 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Converted 1024.00 MB image at 187.02 MB/s Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] 29a17c97-7614-4882-aa90-3bb5ab803cb1 was raw, converting to qcow2 {{(pid=88044) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabccaf-def7-4004-bfdb-d7e4dcba2cdc]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:04 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img Jul 23 03:29:04 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:04 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img" returned: 0 in 0.425s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:04 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img Jul 23 03:29:04 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:04 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img" returned: 1 in 0.377s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img /opt/stack/data/cinder/conversion/vol_upload_l69egtn_ {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:04 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img /opt/stack/data/cinder/conversion/vol_upload_l69egtn_ Jul 23 03:29:04 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:04 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img /opt/stack/data/cinder/conversion/vol_upload_l69egtn_" returned: 0 in 0.289s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Image conversion details: src /opt/stack/data/cinder/conversion/b689a8ec-670f-4fba-b886-a89c12625338.temp_image.29a17c97-7614-4882-aa90-3bb5ab803cb1uli_7ftu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l69egtn_ {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:04 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[77635008-f3a3-4411-a283-ccd45b617d6d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l69egtn_ {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:05 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l69egtn_ Jul 23 03:29:05 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:05 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l69egtn_" returned: 0 in 0.353s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.312s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Uploaded volume to glance image-id: 29a17c97-7614-4882-aa90-3bb5ab803cb1. {{(pid=88044) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.718s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155003046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d31e65c-9078-45de-afec-fd007f33fed4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc36a498410e427791b5182269a4b119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:57Z,use_quota=True,user_id='efc33e0ca365435493d9eda2995d2bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Creating volume 3d31e65c-9078-45de-afec-fd007f33fed4 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:06 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 1073741824 Jul 23 03:29:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6cbef0f0-878d-407c-a07b-fe463606c63e tempest-VolumesActionsTest-1346416954 None] Copy volume to image completed successfully. Jul 23 03:29:06 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:07 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 1073741824" returned: 0 in 0.499s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:07 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 Jul 23 03:29:07 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:07 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4" returned: 0 in 0.286s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.683s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edb7d52-f96b-44a4-bfa7-88307b98598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d31e65c-9078-45de-afec-fd007f33fed4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87596575-26c5-4c39-be0f-692c3aa28dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58848a1-ff5c-4341-82b7-acce112beea0]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Volume volume-3d31e65c-9078-45de-afec-fd007f33fed4 (3d31e65c-9078-45de-afec-fd007f33fed4): created successfully Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87596575-26c5-4c39-be0f-692c3aa28dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Flow 'volume_create_manager' (2ac6ce20-79a6-422a-a15e-65bd35ca3af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f82e371e-ecc6-4694-858b-754d48fc8f22 tempest-VolumesListTestJSON-869240452 None] Created volume successfully. Jul 23 03:29:07 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 Jul 23 03:29:07 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Flow 'volume_create_manager' (912e7441-b5a2-45d7-8f8b-d4f8ab398de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226121cc-3bd3-4133-96d1-92df3487448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226121cc-3bd3-4133-96d1-92df3487448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1872333610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059de5f5-eea4-477a-a41a-b049d2cbb3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac568d6ec54a93a65371a1552fa59d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:08Z,use_quota=True,user_id='c24b6b78824f4f949a0bff23a5ce64cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d448fbf-cec1-46ac-995a-748ce903d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d448fbf-cec1-46ac-995a-748ce903d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4428cab-ade3-44c4-87e9-b0a57ae433de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4428cab-ade3-44c4-87e9-b0a57ae433de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059de5f5-eea4-477a-a41a-b049d2cbb3b4', 'volume_name': 'volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bd23e7-6ba1-4d07-89d2-8df0aaa752ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bd23e7-6ba1-4d07-89d2-8df0aaa752ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cd863-59e5-48b6-87f7-0b9434109297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4', 'volume_size': 1} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:08 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1" returned: 0 in 0.515s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 2G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 2G" returned: 0 in 0.137s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.701s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1872333610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059de5f5-eea4-477a-a41a-b049d2cbb3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac568d6ec54a93a65371a1552fa59d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:08Z,use_quota=True,user_id='c24b6b78824f4f949a0bff23a5ce64cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Creating volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:08 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:08 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 1073741824 Jul 23 03:29:08 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6a349596-26e4-48a0-941f-6e1fdaf3015b tempest-VolumesExtendTest-1807169319 None] Extend volume completed successfully. Jul 23 03:29:09 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 1073741824" returned: 0 in 0.665s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-34722719-8830-42dd-8e41-edf9636bb0a1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:09 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "cinder-34722719-8830-42dd-8e41-edf9636bb0a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-quobyte-34722719-8830-42dd-8e41-edf9636bb0a1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-34722719-8830-42dd-8e41-edf9636bb0a1" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b41355b-2770-4d62-9871-d3f04ddff2e8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:09 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 Jul 23 03:29:09 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Acquiring lock "cinder-quobyte-b689a8ec-670f-4fba-b886-a89c12625338" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-quobyte-b689a8ec-670f-4fba-b886-a89c12625338" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:09 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4" returned: 0 in 0.408s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d608d-632d-4bde-827b-c859e76c874d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cd863-59e5-48b6-87f7-0b9434109297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a948ab6-442c-460d-b1a1-4511d0a721a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:09 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Volume volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 (059de5f5-eea4-477a-a41a-b049d2cbb3b4): created successfully Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a948ab6-442c-460d-b1a1-4511d0a721a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Flow 'volume_create_manager' (912e7441-b5a2-45d7-8f8b-d4f8ab398de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-fe2a2a4a-b565-4818-a277-5a52906454ea tempest-VolumesSnapshotListTestJSON-294635686 None] Created volume successfully. Jul 23 03:29:09 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:29:09 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1 Jul 23 03:29:09 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.499s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-34722719-8830-42dd-8e41-edf9636bb0a1" returned: 0 in 0.294s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338 Jul 23 03:29:10 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-34722719-8830-42dd-8e41-edf9636bb0a1" released by "delete_volume" :: held 0.828s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Created reservations ['cdafcff4-b174-4a86-b60c-2cac5c136504', '5893036e-e64f-4072-b36e-2f299a2319c4', 'afec1303-40c9-4008-975a-5bfef8f85469', '86b4fe41-05e4-4a8b-ace0-f9c1c2ea9aca'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:10 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b689a8ec-670f-4fba-b886-a89c12625338" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-quobyte-b689a8ec-670f-4fba-b886-a89c12625338" released by "delete_volume" :: held 0.942s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Created reservations ['51ba26ad-b41b-4599-91b8-e88954513153', 'bceb0307-91be-4103-aea7-f52cb9fb3bdc', '95df68e6-1581-4f7d-b065-d67a50561022', 'bf341272-aacb-4d98-bff5-3d547b06255f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:10 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:10 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Deleted volume successfully. Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Creating offline snapshot 3997e6c3-284e-4a79-ad4a-c1de4d232d96 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-400f93f7-8b80-417f-bdc1-88fa69b5f2a0 tempest-VolumesExtendTest-1807169319 None] Lock "cinder-34722719-8830-42dd-8e41-edf9636bb0a1-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d52ddfb-2a34-49ee-bde7-d97bd0689e48]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:10 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 Jul 23 03:29:10 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.352s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Deleted volume successfully. Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c3f80984-0bc4-48f7-aed6-5753dc4d2854 tempest-VolumesActionsTest-1346416954 None] Lock "cinder-b689a8ec-670f-4fba-b886-a89c12625338-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Flow 'volume_create_manager' (b3a1e9c1-cdba-4f7f-8add-ee1b9f030380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bdab64-3f31-40ac-9dbf-ef75d7ac9883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bdab64-3f31-40ac-9dbf-ef75d7ac9883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-969745808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3b1412-7f56-43d4-bf6b-148332c093a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1627fa5883437298a17bd66d319365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:11Z,use_quota=True,user_id='3c95d9112b47485ba73f651311a7599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b89137-7aa9-4d01-ba5e-e79e2b32e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b89137-7aa9-4d01-ba5e-e79e2b32e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec51f5e-b49f-40be-ab08-2c0af47a393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec51f5e-b49f-40be-ab08-2c0af47a393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3b1412-7f56-43d4-bf6b-148332c093a5', 'volume_name': 'volume-1c3b1412-7f56-43d4-bf6b-148332c093a5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83a20d-71f2-4d46-bb74-d867826530d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83a20d-71f2-4d46-bb74-d867826530d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e9f1bd-a692-4176-998c-8113539cb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Volume 1c3b1412-7f56-43d4-bf6b-148332c093a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3b1412-7f56-43d4-bf6b-148332c093a5', 'volume_size': 1} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:11 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4" returned: 0 in 0.625s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 1G Jul 23 03:29:11 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-3d31e65c-9078-45de-afec-fd007f33fed4-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "cinder-3d31e65c-9078-45de-afec-fd007f33fed4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-quobyte-3d31e65c-9078-45de-afec-fd007f33fed4" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-3d31e65c-9078-45de-afec-fd007f33fed4" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2238a63c-5cb2-40f6-b051-d959dbe1e46c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 1G" returned: 0 in 0.515s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:11 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 Jul 23 03:29:12 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 is being set with open permissions: ugo+rw Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:12 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4" returned: 0 in 0.425s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4 Jul 23 03:29:12 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3d31e65c-9078-45de-afec-fd007f33fed4" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-3d31e65c-9078-45de-afec-fd007f33fed4" released by "delete_volume" :: held 0.750s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info Jul 23 03:29:12 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Created reservations ['c6a3edef-94ed-409e-aee2-93e230317d4c', 'f55139b0-86cf-4f37-8a64-1a5c30625cbd', '52ee481c-3ea7-4732-b93c-c306ffcf18d3', '1addda57-7f23-4bcd-bbb7-b40b0f6355fb'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:12 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info" returned: 0 in 0.360s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info is being set with open permissions: ugo+rw Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-15f48a80-5c2e-491f-b67f-365f75c86c4e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:13 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info Jul 23 03:29:13 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "cinder-15f48a80-5c2e-491f-b67f-365f75c86c4e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-quobyte-15f48a80-5c2e-491f-b67f-365f75c86c4e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:13 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.345s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Deleted volume successfully. Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-15f48a80-5c2e-491f-b67f-365f75c86c4e" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-82552144-41f8-4ea0-8bcd-a2db5928b67b tempest-VolumesListTestJSON-869240452 None] Lock "cinder-3d31e65c-9078-45de-afec-fd007f33fed4-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d7f02-97bc-428d-9c35-253e63cd6c7e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.info" returned: 0 in 0.348s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-969745808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3b1412-7f56-43d4-bf6b-148332c093a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1627fa5883437298a17bd66d319365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:11Z,use_quota=True,user_id='3c95d9112b47485ba73f651311a7599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Creating volume 1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:13 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 1073741824 Jul 23 03:29:13 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b287d30d-cd34-466b-8fd7-8652db662b80 tempest-VolumesSnapshotListTestJSON-294635686 None] Create snapshot completed successfully Jul 23 03:29:13 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e Jul 23 03:29:13 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 1073741824" returned: 0 in 0.577s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-15f48a80-5c2e-491f-b67f-365f75c86c4e" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-15f48a80-5c2e-491f-b67f-365f75c86c4e" released by "delete_volume" :: held 0.830s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:14 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Created reservations ['63104b9c-b109-47bb-bc9c-d4cdb587bc88', '0722375d-70b7-493f-bf44-f5265a508221', 'ce0d33b2-72f5-4002-ae57-89aca858f94d', 'd91a8487-9fe9-4105-a8c0-6e8adc6b14fa'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:14 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-538f4989-f942-4343-ad14-d2dd70f4cf81-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "cinder-538f4989-f942-4343-ad14-d2dd70f4cf81-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Acquiring lock "cinder-quobyte-538f4989-f942-4343-ad14-d2dd70f4cf81" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:14 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-538f4989-f942-4343-ad14-d2dd70f4cf81" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.512s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.322s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6719acd6-5cd4-40f7-abdb-180cc1b263bd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e9f1bd-a692-4176-998c-8113539cb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3b1412-7f56-43d4-bf6b-148332c093a5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94988f-dfeb-41d3-b04b-1535175bb9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Creating offline snapshot cfb8b739-898d-4e4c-8435-e2da7dd6ec47 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:14 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee774692-dd52-4464-969b-cf0d0275fc7d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.449s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Volume volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 (1c3b1412-7f56-43d4-bf6b-148332c093a5): created successfully Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94988f-dfeb-41d3-b04b-1535175bb9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Flow 'volume_create_manager' (b3a1e9c1-cdba-4f7f-8add-ee1b9f030380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Deleted volume successfully. Jul 23 03:29:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ca2efb4d-18fd-44fe-a693-378a2c6a6b3e tempest-VolumesExtendTest-1807169319 None] Created volume successfully. Jul 23 03:29:14 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 Jul 23 03:29:14 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7cfad2d9-5604-4b8f-b8da-954f1ed6dd34 tempest-VolumesListTestJSON-869240452 None] Lock "cinder-15f48a80-5c2e-491f-b67f-365f75c86c4e-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:14 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:14 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81" returned: 0 in 0.508s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81 Jul 23 03:29:15 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 1G Jul 23 03:29:15 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-538f4989-f942-4343-ad14-d2dd70f4cf81" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "cinder-quobyte-538f4989-f942-4343-ad14-d2dd70f4cf81" released by "delete_volume" :: held 0.951s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Created reservations ['cc4baa2c-2618-477f-95f3-cd8374c796ab', '34edbdf3-87b3-4573-861b-fc761072b615', 'fa9fa389-0c96-48ca-9180-df505a108b75', '3f61464e-6a02-4cf8-8724-9597b572cb47'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:15 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:16 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 1G" returned: 0 in 0.803s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:16 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Deleted volume successfully. Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4a7d1cc9-a914-41ea-8855-53d4d3f152fe tempest-VolumesListTestJSON-869240452 None] Lock "cinder-538f4989-f942-4343-ad14-d2dd70f4cf81-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:16 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 is being set with open permissions: ugo+rw Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:16 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.759s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Creating offline snapshot f848132e-133b-4d09-8900-4f7d8fe04a6d of volume 1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1839ae96-b7e4-484a-a877-b01d088c2fd7 tempest-VolumesSnapshotListTestJSON-294635686 None] Create snapshot completed successfully Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da5cb44-b007-4096-bec8-7e217da6a248]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:16 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.463s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:17 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d 1G Jul 23 03:29:17 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:18 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d 1G" returned: 0 in 0.781s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:18 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d Jul 23 03:29:18 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:18 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:18 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d is being set with open permissions: ugo+rw Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:18 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d Jul 23 03:29:18 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:18 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:18 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info Jul 23 03:29:18 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:19 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info" returned: 0 in 0.406s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:19 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info is being set with open permissions: ugo+rw Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:19 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info Jul 23 03:29:19 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:19 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.info" returned: 0 in 0.302s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.781s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Creating offline snapshot 68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1de42e-e708-45dd-8f54-fd867c3e90da]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8419f4bf-ead8-4b4b-83d0-e39a72c92fe2 tempest-VolumesExtendTest-1807169319 None] Create snapshot completed successfully Jul 23 03:29:19 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:19 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:20 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.473s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:20 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 1G Jul 23 03:29:20 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:20 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 1G" returned: 0 in 0.634s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:20 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 Jul 23 03:29:20 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:21 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" returned: 0 in 0.363s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:21 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 is being set with open permissions: ugo+rw Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:21 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 Jul 23 03:29:21 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:21 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.049s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b10df1-d76f-44f1-a8d0-57fd6ce853d7]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-98ed3594-6c79-460f-b739-4eeeb1e56c14 tempest-VolumesSnapshotListTestJSON-294635686 None] Create snapshot completed successfully Jul 23 03:29:21 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:21 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:21 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.485s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d 2G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d 2G" returned: 0 in 0.220s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.784s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5d1c0f6d-f920-4962-8ee2-a6a8d76738a1 tempest-VolumesExtendTest-1807169319 None] Extend volume completed successfully. Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-f848132e-133b-4d09-8900-4f7d8fe04a6d-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-f848132e-133b-4d09-8900-4f7d8fe04a6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-quobyte-f848132e-133b-4d09-8900-4f7d8fe04a6d" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-f848132e-133b-4d09-8900-4f7d8fe04a6d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Deleting offline snapshot f848132e-133b-4d09-8900-4f7d8fe04a6d of volume 1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] snapshot_file for this snap is: volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ba0c3-6645-45b4-853d-88caac5decdf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Deleting offline snapshot 68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] snapshot_file for this snap is: volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c6492-122c-4fb0-b218-2889e30a6967]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d Jul 23 03:29:23 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 Jul 23 03:29:23 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d" returned: 0 in 0.525s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c3b1412-7f56-43d4-bf6b-148332c093a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e692a-3d93-4f9f-bd28-d758bf833bb5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ccd5a0-602a-4ddc-816c-337df7130f59]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:23 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:23 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.488s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d Jul 23 03:29:24 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.609s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 Jul 23 03:29:24 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d Jul 23 03:29:24 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" returned: 0 in 0.573s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7 Jul 23 03:29:24 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5.f848132e-133b-4d09-8900-4f7d8fe04a6d" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-f848132e-133b-4d09-8900-4f7d8fe04a6d" released by "_delete_snapshot" :: held 2.092s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" released by "delete_snapshot" :: held 2.137s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Created reservations ['42bc31d1-4c0f-48f0-ab87-ac3b55137ce6', '7b06b449-3846-41bc-8024-ae51ef2974eb', '9c1b993b-bb77-498f-a639-d9a485c352b5', '4b044790-7cbb-4d4d-813f-4be5aac155d8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:25 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" returned: 0 in 0.322s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7" released by "_delete_snapshot" :: held 2.093s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" released by "delete_snapshot" :: held 2.133s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Flow 'volume_create_manager' (a41ccf68-e1ff-41e6-9811-24ab0c365339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cec8e-3242-45c2-9efe-dda6079f3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cec8e-3242-45c2-9efe-dda6079f3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8638f0-5c6f-4b58-ba1b-3afaf191b3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ad96fb010c469796050504adf93f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:25Z,use_quota=True,user_id='49f479e4ea674981ad4b2e9fe5b6d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2245dee-0536-4ea9-9abd-ebec66dfa863),volume_type_id=d2245dee-0536-4ea9-9abd-ebec66dfa863)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e6946-607d-42ac-9ea8-b1bd450352da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e6946-607d-42ac-9ea8-b1bd450352da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b2a27f-33af-4b2c-aed8-d90e9afa3c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:29:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Delete snapshot completed successfully. Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-565faf77-da95-492b-975f-52b2c9dd485a tempest-VolumesExtendTest-1807169319 None] Lock "cinder-f848132e-133b-4d09-8900-4f7d8fe04a6d-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Created reservations ['888eee76-a113-4c3b-aed8-deb5764cf09e', 'a8dcdf11-2728-4bd2-870b-f56a6ab30765', 'c4ef541a-2b95-456d-9f6c-219a6fe25600', '1517c17d-8b3c-4576-99e7-1b489e693e20'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Delete snapshot completed successfully. Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9f4626e-b02c-4dea-ada0-9c96a00f9882 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-68cd38b3-d63c-4cde-8c36-30bf60ff8ee7-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b2a27f-33af-4b2c-aed8-d90e9afa3c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b8638f0-5c6f-4b58-ba1b-3afaf191b3df', 'volume_name': 'volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df', 'volume_size': 1, 'image_id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'beab18230ce8d4cc5c50a18f67ba9ef5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84ad96fb010c469796050504adf93f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '226429341c623b8340553035d8dc1a9f36f123918d237c5bd5242cfcd5dc73bdc00292cc873b45dbab8c43fdc1d71315ac16952a41af4e411a61e014529173d2', 'id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b643cb16-2863-4cba-a515-e31d222ac5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b643cb16-2863-4cba-a515-e31d222ac5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086b699f-2dff-4c2b-a88d-58ec399a220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df', 'volume_size': 1, 'image_id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'beab18230ce8d4cc5c50a18f67ba9ef5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84ad96fb010c469796050504adf93f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '226429341c623b8340553035d8dc1a9f36f123918d237c5bd5242cfcd5dc73bdc00292cc873b45dbab8c43fdc1d71315ac16952a41af4e411a61e014529173d2', 'id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Trying to clone 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df from image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:29:25 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef3b184-6419-48fa-958c-2c8499b8e506]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:25 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-1c3b1412-7f56-43d4-bf6b-148332c093a5-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "cinder-1c3b1412-7f56-43d4-bf6b-148332c093a5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Acquiring lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-cfb8b739-898d-4e4c-8435-e2da7dd6ec47-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32eccba-8525-4f50-99a0-9d8273d51bab]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:26 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-cfb8b739-898d-4e4c-8435-e2da7dd6ec47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-cfb8b739-898d-4e4c-8435-e2da7dd6ec47" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-cfb8b739-898d-4e4c-8435-e2da7dd6ec47" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Deleting offline snapshot cfb8b739-898d-4e4c-8435-e2da7dd6ec47 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] snapshot_file for this snap is: volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6058620a-8180-407c-94b3-8d24943e2dad]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:26 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Temporary image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 is fetched for user 49f479e4ea674981ad4b2e9fe5b6d499. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:29:26 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:26 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[913a9271-0a13-451c-bfad-4ac16935b0ce]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:26 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.636s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5 Jul 23 03:29:27 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.567s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc287fb-dd94-4330-b348-df5007067f12]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:27 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1c3b1412-7f56-43d4-bf6b-148332c093a5" returned: 0 in 0.366s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "cinder-quobyte-1c3b1412-7f56-43d4-bf6b-148332c093a5" released by "delete_volume" :: held 1.142s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:27 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:27 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Created reservations ['6371c7c9-6c73-496f-b584-9fe4e4df7153', 'b2bff842-d782-46c9-aa23-e48e5a6ecc14', 'dfce27ac-1bc1-4963-b808-3768c5e9a7d7', '87c113a7-9459-407d-9f2d-f738d2a444a6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:27 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.656s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8638f0-5c6f-4b58-ba1b-3afaf191b3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ad96fb010c469796050504adf93f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:25Z,use_quota=True,user_id='49f479e4ea674981ad4b2e9fe5b6d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2245dee-0536-4ea9-9abd-ebec66dfa863),volume_type_id=d2245dee-0536-4ea9-9abd-ebec66dfa863)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Creating volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:27 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:27 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1073741824 Jul 23 03:29:27 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Deleted volume successfully. Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ced2cffc-981b-497a-a474-bcbff6f63a3c tempest-VolumesExtendTest-1807169319 None] Lock "cinder-1c3b1412-7f56-43d4-bf6b-148332c093a5-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:28 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.512s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:28 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47 Jul 23 03:29:28 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1073741824" returned: 0 in 0.787s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:28 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.cfb8b739-898d-4e4c-8435-e2da7dd6ec47" returned: 0 in 0.426s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df Jul 23 03:29:28 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-cfb8b739-898d-4e4c-8435-e2da7dd6ec47" released by "_delete_snapshot" :: held 2.352s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" released by "delete_snapshot" :: held 2.396s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:28 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Created reservations ['23d641b5-20b8-48e8-86ff-47da7d503734', 'f7302bb5-6768-4f5d-9b4e-dcf8d9be11af', '8c18bb71-bdd6-45b0-9971-5fe6a4e4e149', '67bf5b8a-fcf3-4079-a922-a178a4c827dc'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Delete snapshot completed successfully. Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-10736ddc-8ece-425e-a950-556287f1bcef tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-cfb8b739-898d-4e4c-8435-e2da7dd6ec47-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:29 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" returned: 0 in 0.474s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Attempting download of 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}])) to volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3253ea-0997-4c98-a240-1c7eb6ecc5ef]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm Jul 23 03:29:29 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-3997e6c3-284e-4a79-ad4a-c1de4d232d96-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-3997e6c3-284e-4a79-ad4a-c1de4d232d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-3997e6c3-284e-4a79-ad4a-c1de4d232d96" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:29 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm" returned: 0 in 0.433s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-3997e6c3-284e-4a79-ad4a-c1de4d232d96" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Deleting offline snapshot 3997e6c3-284e-4a79-ad4a-c1de4d232d96 of volume 059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] snapshot_file for this snap is: volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67b274-fad5-4ad8-9807-a99fc8bbc78d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm Jul 23 03:29:29 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:30 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm" returned: 1 in 0.465s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_klntmgwm' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9c56d-1f31-4a6f-961a-4c41ddf352ab]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.570s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:30 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22b763-0f50-4fe6-a943-8ceaf95ab6a9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 Jul 23 03:29:30 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD Jul 23 03:29:30 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4" returned: 0 in 0.515s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:31 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 was raw, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df Jul 23 03:29:31 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.554s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96 Jul 23 03:29:31 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4.3997e6c3-284e-4a79-ad4a-c1de4d232d96" returned: 0 in 0.421s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-3997e6c3-284e-4a79-ad4a-c1de4d232d96" released by "_delete_snapshot" :: held 2.216s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" released by "delete_snapshot" :: held 2.261s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Created reservations ['a5917492-66ff-4dff-8b4b-e19b2f616a65', 'a0e12f14-2081-42e2-9f1d-0a09544dcefc', 'e96e4f2a-25e9-458c-ba4a-44145f379495', '05f2e8e6-c893-4c1f-815f-b1fc9bfcea94'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:32 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" returned: 0 in 0.878s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c6e6609-bbfd-4bf8-8b06-12ec5e909051_b_9vs8rmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:32 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Delete snapshot completed successfully. Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c72954af-550e-44f1-af52-b484ab4ff143 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-3997e6c3-284e-4a79-ad4a-c1de4d232d96-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:32 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1G Jul 23 03:29:32 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:32 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df 1G" returned: 0 in 0.493s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Downloaded image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}])) to volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Temporary image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 for user 49f479e4ea674981ad4b2e9fe5b6d499 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Marking volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Copying metadata from image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 to 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Creating volume glance metadata for volume 2b8638f0-5c6f-4b58-ba1b-3afaf191b3df backed by image 1c6e6609-bbfd-4bf8-8b06-12ec5e909051 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'beab18230ce8d4cc5c50a18f67ba9ef5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086b699f-2dff-4c2b-a88d-58ec399a220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df', 'volume_size': 1, 'image_id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'beab18230ce8d4cc5c50a18f67ba9ef5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '84ad96fb010c469796050504adf93f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '226429341c623b8340553035d8dc1a9f36f123918d237c5bd5242cfcd5dc73bdc00292cc873b45dbab8c43fdc1d71315ac16952a41af4e411a61e014529173d2', 'id': '1c6e6609-bbfd-4bf8-8b06-12ec5e909051', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c6e6609-bbfd-4bf8-8b06-12ec5e909051/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37850bce-b6d1-40f9-9114-2364ba816199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Volume volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df (2b8638f0-5c6f-4b58-ba1b-3afaf191b3df): created successfully Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37850bce-b6d1-40f9-9114-2364ba816199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Flow 'volume_create_manager' (a41ccf68-e1ff-41e6-9811-24ab0c365339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6b00d2a4-b9eb-4484-81dc-2ff805b82efc tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Created volume successfully. Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-059de5f5-eea4-477a-a41a-b049d2cbb3b4-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-059de5f5-eea4-477a-a41a-b049d2cbb3b4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (854576c0-59b2-46c0-ae09-b43308219557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3fad4-e913-4b2f-a57f-85ac97acc9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3fad4-e913-4b2f-a57f-85ac97acc9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-326711034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d43e84e-9695-4823-a66a-dbd7f34ef592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:33Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca62a35e-9926-46fb-a078-7b573ea526d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca62a35e-9926-46fb-a078-7b573ea526d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513d878-49ff-40e9-8d73-44b2b19b74b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513d878-49ff-40e9-8d73-44b2b19b74b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d43e84e-9695-4823-a66a-dbd7f34ef592', 'volume_name': 'volume-2d43e84e-9695-4823-a66a-dbd7f34ef592', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35da176e-54db-41c6-8dd0-1570d3d51ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35da176e-54db-41c6-8dd0-1570d3d51ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db4358b-cbe2-49df-8374-8e4f359a4df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Volume 2d43e84e-9695-4823-a66a-dbd7f34ef592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d43e84e-9695-4823-a66a-dbd7f34ef592', 'volume_size': 1} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-326711034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d43e84e-9695-4823-a66a-dbd7f34ef592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:33Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Creating volume 2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:33 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 1073741824 Jul 23 03:29:33 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e997d3-b273-47bb-9757-5951ca6cacec]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 Jul 23 03:29:33 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:33 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 1073741824" returned: 0 in 0.572s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:33 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4" returned: 0 in 0.507s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4 Jul 23 03:29:33 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Acquiring lock "cinder-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:33 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 Jul 23 03:29:33 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "cinder-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Acquiring lock "cinder-quobyte-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "cinder-quobyte-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026342e-e4ad-4f92-9d45-2de14dd4f51b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-059de5f5-eea4-477a-a41a-b049d2cbb3b4" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-quobyte-059de5f5-eea4-477a-a41a-b049d2cbb3b4" released by "delete_volume" :: held 0.949s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:34 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592" returned: 0 in 0.375s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:34 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db4358b-cbe2-49df-8374-8e4f359a4df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d43e84e-9695-4823-a66a-dbd7f34ef592', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697f42ab-0985-40f5-a588-77d3558ab8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Volume volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 (2d43e84e-9695-4823-a66a-dbd7f34ef592): created successfully Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697f42ab-0985-40f5-a588-77d3558ab8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (854576c0-59b2-46c0-ae09-b43308219557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c370c9fc-e00a-4d63-89bc-041e47e41f50 tempest-VolumesSnapshotTestJSON-800927785 None] Created volume successfully. Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Created reservations ['1115c11a-0190-44b9-baa1-4d909e512d4b', 'e43d679f-b29e-4820-ba0e-b455d8212688', 'd2ef293c-8f28-42d6-add0-f38cc9bc3ec9', 'b48b19e8-e710-4c9f-8522-7c416e61802b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:34 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" returned: 0 in 0.526s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df Jul 23 03:29:34 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (970da626-55d3-4077-8c55-169cea3faf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b43eadb-04eb-4d01-8bf0-91b58fa65754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b43eadb-04eb-4d01-8bf0-91b58fa65754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018736501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f42454-0a51-4bcb-84fa-ca6b76211faf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:35Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a19071-0dca-4f49-a002-ff9afac24b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a19071-0dca-4f49-a002-ff9afac24b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7ebfb-a974-4588-ab61-c5b65c663662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7ebfb-a974-4588-ab61-c5b65c663662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f42454-0a51-4bcb-84fa-ca6b76211faf', 'volume_name': 'volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a1b49e-1b21-4977-a2a2-506cd76baf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a1b49e-1b21-4977-a2a2-506cd76baf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50042dee-522a-4288-adb9-8e318eedb2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Volume a9f42454-0a51-4bcb-84fa-ca6b76211faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf', 'volume_size': 1} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018736501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f42454-0a51-4bcb-84fa-ca6b76211faf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:35Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Creating volume a9f42454-0a51-4bcb-84fa-ca6b76211faf {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:34 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Deleted volume successfully. Jul 23 03:29:34 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf 1073741824 Jul 23 03:29:34 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ac8e1ea8-11a9-4804-92ab-d4da4339fcc7 tempest-VolumesSnapshotListTestJSON-294635686 None] Lock "cinder-059de5f5-eea4-477a-a41a-b049d2cbb3b4-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:34 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "cinder-quobyte-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df" released by "delete_volume" :: held 0.899s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:35 devstack cinder-volume[88044]: WARNING cinder.quota [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:35 devstack cinder-volume[88044]: WARNING cinder.quota [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Created reservations ['a82db67c-b6f1-480c-92a8-cfc19e95a193', 'b7504edd-cf18-416c-bc73-fb0f1e8fce94', '113d5682-1461-44c7-b6c1-32f43afe8f16', '4fb0f60a-d799-46ee-90b0-b71177407b55'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:35 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:35 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf 1073741824" returned: 0 in 0.690s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Deleted volume successfully. Jul 23 03:29:35 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf Jul 23 03:29:35 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d3ced3e6-aac5-43d1-bcf5-8f85bcfc86b7 tempest-VolumeAndVolumeTypeFromImageTest-986985125 None] Lock "cinder-2b8638f0-5c6f-4b58-ba1b-3afaf191b3df-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:35 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:35 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:36 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf" returned: 0 in 0.508s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.267s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50042dee-522a-4288-adb9-8e318eedb2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a15169-6853-48e9-8235-4399308e2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Creating offline snapshot 517bd08c-658c-4c5c-bd5f-8529142025e2 of volume 2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:36 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Volume volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf (a9f42454-0a51-4bcb-84fa-ca6b76211faf): created successfully Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a15169-6853-48e9-8235-4399308e2f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (970da626-55d3-4077-8c55-169cea3faf0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[14820df3-641d-45bf-94c0-69f73167243b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2037bacc-0913-4b1f-863e-d130785ab804 tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:29:36 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 Jul 23 03:29:36 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:36 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.527s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:29:36 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:36 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 1G Jul 23 03:29:36 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:37 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 1G" returned: 0 in 0.622s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:37 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 Jul 23 03:29:37 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:37 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2" returned: 0 in 0.421s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:37 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 is being set with open permissions: ugo+rw Jul 23 03:29:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:37 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 Jul 23 03:29:37 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (e63986e4-9250-42f9-b406-35b1779b0314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11413446-63c6-4950-97b7-39a04ed1ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11413446-63c6-4950-97b7-39a04ed1ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106771599',display_name='tempest-VolumesGetTest-Volume-1173589988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3cddfc-a58b-4176-8e5f-8d153d309851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:38Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de73fb00-030c-48a4-aa41-ac29ce283fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:38 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de73fb00-030c-48a4-aa41-ac29ce283fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:38 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f07212-2cc9-4c1e-bd80-6b429cd3d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f07212-2cc9-4c1e-bd80-6b429cd3d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3cddfc-a58b-4176-8e5f-8d153d309851', 'volume_name': 'volume-8d3cddfc-a58b-4176-8e5f-8d153d309851', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e882318-708e-47ed-9c6c-5c0b965b5acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e882318-708e-47ed-9c6c-5c0b965b5acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a323e-20a8-4305-955c-53570f19c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Volume 8d3cddfc-a58b-4176-8e5f-8d153d309851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3cddfc-a58b-4176-8e5f-8d153d309851', 'volume_size': 1} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:38 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info is being set with open permissions: ugo+rw Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:38 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info Jul 23 03:29:38 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.info" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106771599',display_name='tempest-VolumesGetTest-Volume-1173589988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3cddfc-a58b-4176-8e5f-8d153d309851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:38Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Creating volume 8d3cddfc-a58b-4176-8e5f-8d153d309851 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:38 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:38 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 1073741824 Jul 23 03:29:38 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cb25444e-13ab-4877-950c-2504552b4edd tempest-VolumesSnapshotTestJSON-800927785 None] Create snapshot completed successfully Jul 23 03:29:39 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 1073741824" returned: 0 in 0.580s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:39 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 Jul 23 03:29:39 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:39 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a323e-20a8-4305-955c-53570f19c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3cddfc-a58b-4176-8e5f-8d153d309851', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219f5a5-cbe8-4fe5-8c89-3883eb01e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Volume volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 (8d3cddfc-a58b-4176-8e5f-8d153d309851): created successfully Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219f5a5-cbe8-4fe5-8c89-3883eb01e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (e63986e4-9250-42f9-b406-35b1779b0314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a60a000b-daa6-4021-9756-6b382f0ecbcc tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-517bd08c-658c-4c5c-bd5f-8529142025e2-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-517bd08c-658c-4c5c-bd5f-8529142025e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-517bd08c-658c-4c5c-bd5f-8529142025e2" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-517bd08c-658c-4c5c-bd5f-8529142025e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Deleting offline snapshot 517bd08c-658c-4c5c-bd5f-8529142025e2 of volume 2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] snapshot_file for this snap is: volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33391e-68bb-42cc-a2c8-996cdc4d44ff]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-8d3cddfc-a58b-4176-8e5f-8d153d309851-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "cinder-8d3cddfc-a58b-4176-8e5f-8d153d309851-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-8d3cddfc-a58b-4176-8e5f-8d153d309851" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-8d3cddfc-a58b-4176-8e5f-8d153d309851" acquired by "delete_volume" :: waited 0.065s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:40 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 Jul 23 03:29:40 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de141af-2271-45e1-b206-11d33f6d7539]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:40 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 Jul 23 03:29:40 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:40 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2" returned: 0 in 0.602s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d43e84e-9695-4823-a66a-dbd7f34ef592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca345531-68ff-4084-a6da-0130ca51681e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851" returned: 0 in 0.539s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 Jul 23 03:29:41 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851 Jul 23 03:29:41 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d3cddfc-a58b-4176-8e5f-8d153d309851" returned: 0 in 0.377s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-8d3cddfc-a58b-4176-8e5f-8d153d309851" released by "delete_volume" :: held 0.973s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:41 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592" returned: 0 in 0.600s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 Jul 23 03:29:41 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Created reservations ['c0ef7ccb-80f4-49c5-86e0-197919a5d45f', '5455bb5a-66dc-4603-adcf-a6d3312ccbf7', '49985b01-ad0b-4e62-87f5-34c582f44f37', 'a56195b2-d893-41a3-bc9e-9cd9a3b69792'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:41 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.359s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:42 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2" returned: 0 in 0.539s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:42 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2 Jul 23 03:29:42 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (9c85d3b7-c0b9-466a-84fb-e3f42f210e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41aa609-6a21-4f3d-b649-f4a3fe8e47bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41aa609-6a21-4f3d-b649-f4a3fe8e47bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192908307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472084b9-3f69-49ae-939a-254eb646186d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:42Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d3434-efee-4a2c-bda1-aa77e6de95d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d3434-efee-4a2c-bda1-aa77e6de95d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72bcfb2-4019-4d0f-8c06-4f404465befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72bcfb2-4019-4d0f-8c06-4f404465befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472084b9-3f69-49ae-939a-254eb646186d', 'volume_name': 'volume-472084b9-3f69-49ae-939a-254eb646186d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58d6c1a-f7ab-4c6b-b233-d49080dde87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58d6c1a-f7ab-4c6b-b233-d49080dde87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c427c6-b1d3-4cdd-965d-2a449ad61868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:42 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume 472084b9-3f69-49ae-939a-254eb646186d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472084b9-3f69-49ae-939a-254eb646186d', 'volume_size': 1} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192908307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472084b9-3f69-49ae-939a-254eb646186d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:42Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume 472084b9-3f69-49ae-939a-254eb646186d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:42 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-053bdc30-a8df-46e2-b4db-b320b7b9efb7 tempest-VolumesGetTest-998552848 None] Lock "cinder-8d3cddfc-a58b-4176-8e5f-8d153d309851-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d 1073741824 Jul 23 03:29:42 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592.517bd08c-658c-4c5c-bd5f-8529142025e2" returned: 0 in 0.293s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-517bd08c-658c-4c5c-bd5f-8529142025e2" released by "_delete_snapshot" :: held 2.181s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" released by "delete_snapshot" :: held 2.210s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['15637170-5cf1-400e-92bc-c9ebc6efb28a', '57e29c00-8798-4d20-98b2-490c931a66c8', '29f25fcd-ce87-4dfe-bca8-a54908577f2b', 'd681ba01-6278-4b4a-9c0d-a703439fe023'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Delete snapshot completed successfully. Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae69ca29-e263-4396-87f3-bb21fd9644b2 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-517bd08c-658c-4c5c-bd5f-8529142025e2-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d 1073741824" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-a9f42454-0a51-4bcb-84fa-ca6b76211faf-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "cinder-a9f42454-0a51-4bcb-84fa-ca6b76211faf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:42 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d Jul 23 03:29:42 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-a9f42454-0a51-4bcb-84fa-ca6b76211faf" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-a9f42454-0a51-4bcb-84fa-ca6b76211faf" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c2ffa-aa61-4c4f-bd25-0038f868f531]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf Jul 23 03:29:43 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d" returned: 0 in 0.323s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c427c6-b1d3-4cdd-965d-2a449ad61868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472084b9-3f69-49ae-939a-254eb646186d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7e4277-e4ac-47c5-a2e3-b59bab09c44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-472084b9-3f69-49ae-939a-254eb646186d (472084b9-3f69-49ae-939a-254eb646186d): created successfully Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7e4277-e4ac-47c5-a2e3-b59bab09c44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (9c85d3b7-c0b9-466a-84fb-e3f42f210e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4369c9c1-9ce2-4068-b74d-2f8bcc85cae1 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:43 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf" returned: 0 in 0.419s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf Jul 23 03:29:43 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a9f42454-0a51-4bcb-84fa-ca6b76211faf" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-a9f42454-0a51-4bcb-84fa-ca6b76211faf" released by "delete_volume" :: held 0.805s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Created reservations ['aeb5115e-dcd8-4632-acd1-95f19c938ee6', '38601765-296b-407f-a5c0-7fb3bdcf43ad', '6f65bd01-c58c-4f9f-a75e-2253a5ad7287', 'f1d362b7-e7d1-49e0-b8be-74edb16c563f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:44 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:44 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (e2deaeb1-27bf-4ad0-ad29-8166f8314ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d57d0b-62fa-425b-8fdd-9e942a148b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d57d0b-62fa-425b-8fdd-9e942a148b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1972614404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055cefc-9187-4870-9064-68b942c7dbc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:44Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624bc5f3-f55b-4919-8b03-54e722214d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624bc5f3-f55b-4919-8b03-54e722214d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27576e38-be91-409f-a230-ff76d494c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27576e38-be91-409f-a230-ff76d494c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b055cefc-9187-4870-9064-68b942c7dbc5', 'volume_name': 'volume-b055cefc-9187-4870-9064-68b942c7dbc5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2bca0e-5878-42d1-b9b4-e94b834a7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2bca0e-5878-42d1-b9b4-e94b834a7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1bdac9-0d0c-49d8-8d80-d93d2ca1d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Volume b055cefc-9187-4870-9064-68b942c7dbc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b055cefc-9187-4870-9064-68b942c7dbc5', 'volume_size': 1} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1972614404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055cefc-9187-4870-9064-68b942c7dbc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:44Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Creating volume b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:44 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.596s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:29:44 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 1073741824 Jul 23 03:29:44 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6c3b9d4e-4f7f-4278-a2ad-03f51cd0756f tempest-VolumesGetTest-998552848 None] Lock "cinder-a9f42454-0a51-4bcb-84fa-ca6b76211faf-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (e4544b37-a694-498b-82c6-0d8350f5a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45625ce4-8fd3-4d29-bb0a-26d586196ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45625ce4-8fd3-4d29-bb0a-26d586196ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1580158839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3ad722-2cb2-4e5b-94f8-3d58dc004243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:45Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf0716-c010-40f1-9ec7-6c5fe7bcbe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf0716-c010-40f1-9ec7-6c5fe7bcbe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36377d79-b2e5-4aa7-a681-8a491a444298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36377d79-b2e5-4aa7-a681-8a491a444298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'volume_name': 'volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4441c0-c8f2-40ce-83c9-83218bb08989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4441c0-c8f2-40ce-83c9-83218bb08989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dc01ee-b597-4781-9be3-8f37ca290a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:44 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Volume 0f3ad722-2cb2-4e5b-94f8-3d58dc004243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'volume_size': 1} Jul 23 03:29:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=166,cinder:INSERT=52,cinder:SELECT=143,cinder:DELETE=15 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:29:45 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (1864498e-a90a-4abb-aeb3-1ba25b9552bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9e8658-d5bc-451e-81a8-c27c3e5b750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 1073741824" returned: 0 in 0.841s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9e8658-d5bc-451e-81a8-c27c3e5b750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386016891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c5e9e8-c8ba-4cca-abec-645b537c3c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:45Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ee2ea3-9b11-4cde-9bd2-ee193e7174d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ee2ea3-9b11-4cde-9bd2-ee193e7174d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3269dc70-cde1-41dd-a5eb-24860975c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3269dc70-cde1-41dd-a5eb-24860975c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c5e9e8-c8ba-4cca-abec-645b537c3c4b', 'volume_name': 'volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c512b749-deb5-423e-8cb9-31b81e27036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c512b749-deb5-423e-8cb9-31b81e27036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a85a4-ae18-4385-aef3-fa7b30eb2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume c0c5e9e8-c8ba-4cca-abec-645b537c3c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b', 'volume_size': 1} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:45 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:29:45 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (5afb4d28-0e47-4e95-86e8-41570169639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50053b3f-826a-484b-ae4e-4109cf650591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.455s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50053b3f-826a-484b-ae4e-4109cf650591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1539215129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31bb65b-3b0a-45f0-aaf5-e2f264e28350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd822f-3239-457f-a7b0-c5e748de23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd822f-3239-457f-a7b0-c5e748de23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e14e6df-c273-46f0-b92e-6025e96fe1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e14e6df-c273-46f0-b92e-6025e96fe1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31bb65b-3b0a-45f0-aaf5-e2f264e28350', 'volume_name': 'volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1962d33-696b-40e9-922b-705e957110a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1962d33-696b-40e9-922b-705e957110a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2aad3e-a111-489d-8038-ee0cba737115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume c31bb65b-3b0a-45f0-aaf5-e2f264e28350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350', 'volume_size': 1} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1580158839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3ad722-2cb2-4e5b-94f8-3d58dc004243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:45Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Creating volume 0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:46 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1bdac9-0d0c-49d8-8d80-d93d2ca1d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b055cefc-9187-4870-9064-68b942c7dbc5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc8bea5-811a-4187-9cd1-fa790693c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 1073741824 Jul 23 03:29:46 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Volume volume-b055cefc-9187-4870-9064-68b942c7dbc5 (b055cefc-9187-4870-9064-68b942c7dbc5): created successfully Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc8bea5-811a-4187-9cd1-fa790693c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (e2deaeb1-27bf-4ad0-ad29-8166f8314ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9fe95814-506b-4ead-8c3b-47672d45f381 tempest-VolumesSnapshotTestJSON-800927785 None] Created volume successfully. Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (1f09c2a9-6eb6-4783-bb9a-d45d43470eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e4cc35-332f-41bc-8a4c-8fe44bb38adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e4cc35-332f-41bc-8a4c-8fe44bb38adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342380799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a714a2-da7f-48d3-ab86-e60eff0ce515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5127f08a-8ef7-4548-9fdb-057ad3bf5946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5127f08a-8ef7-4548-9fdb-057ad3bf5946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ad102a-d9e0-4c35-8bae-609cfb879ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ad102a-d9e0-4c35-8bae-609cfb879ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a714a2-da7f-48d3-ab86-e60eff0ce515', 'volume_name': 'volume-91a714a2-da7f-48d3-ab86-e60eff0ce515', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a0820f-8dd4-4ddf-92f3-ce6c0478c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a0820f-8dd4-4ddf-92f3-ce6c0478c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f9a826-c873-4b09-9187-4b6cc4ec31c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume 91a714a2-da7f-48d3-ab86-e60eff0ce515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a714a2-da7f-48d3-ab86-e60eff0ce515', 'volume_size': 1} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:46 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 1073741824" returned: 0 in 0.748s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:46 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:29:46 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (ad833a3d-e42a-4aa2-91d5-757341f68e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ac1f5-09a3-43d9-9828-ab6bc1bc8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ac1f5-09a3-43d9-9828-ab6bc1bc8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057947450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc20824-36c8-4516-adcd-ebe1703d9b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:47Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019c09aa-fd83-4732-acc9-e355bb2646fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019c09aa-fd83-4732-acc9-e355bb2646fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4e03ed-4c29-4b12-9ebd-fe726879dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4e03ed-4c29-4b12-9ebd-fe726879dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc20824-36c8-4516-adcd-ebe1703d9b04', 'volume_name': 'volume-cdc20824-36c8-4516-adcd-ebe1703d9b04', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b09130-f730-4500-921c-7f383a69c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b09130-f730-4500-921c-7f383a69c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3de18a5-895a-441b-96d8-65a68d858227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume cdc20824-36c8-4516-adcd-ebe1703d9b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc20824-36c8-4516-adcd-ebe1703d9b04', 'volume_size': 1} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:47 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.845s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386016891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c5e9e8-c8ba-4cca-abec-645b537c3c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:45Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume c0c5e9e8-c8ba-4cca-abec-645b537c3c4b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:47 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dc01ee-b597-4781-9be3-8f37ca290a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b 1073741824 Jul 23 03:29:47 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6174cfbf-afe1-48eb-84a1-b8880ad3fc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Volume volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 (0f3ad722-2cb2-4e5b-94f8-3d58dc004243): created successfully Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6174cfbf-afe1-48eb-84a1-b8880ad3fc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (e4544b37-a694-498b-82c6-0d8350f5a334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-581edc14-4e91-4dfc-8b1c-08d433a6eb75 tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (950f1d17-1e77-4081-a2ef-70fadac18bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c403c-3ecc-4b55-8afd-1a1e4945c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c403c-3ecc-4b55-8afd-1a1e4945c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562537285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:47Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d0caa-4e73-4e7a-a7ec-60118aba2a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d0caa-4e73-4e7a-a7ec-60118aba2a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe9b427-4fc1-4814-9253-fa3180fdc5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe9b427-4fc1-4814-9253-fa3180fdc5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297', 'volume_name': 'volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8908931c-f07f-4d39-8175-a476c396d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8908931c-f07f-4d39-8175-a476c396d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdee16-0399-4520-bca4-0b28be76ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume 3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297', 'volume_size': 1} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:47 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b 1073741824" returned: 0 in 0.616s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:47 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b Jul 23 03:29:47 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:48 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1539215129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31bb65b-3b0a-45f0-aaf5-e2f264e28350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume c31bb65b-3b0a-45f0-aaf5-e2f264e28350 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:48 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a85a4-ae18-4385-aef3-fa7b30eb2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72707d1b-0260-47e6-99e5-18fb92e37cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:48 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 1073741824 Jul 23 03:29:48 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b (c0c5e9e8-c8ba-4cca-abec-645b537c3c4b): created successfully Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72707d1b-0260-47e6-99e5-18fb92e37cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (1864498e-a90a-4abb-aeb3-1ba25b9552bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-084cdd2c-e060-466c-8282-f2913be32e6b tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:48 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:49 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 1073741824" returned: 0 in 0.762s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (c8b41d66-2b88-4a3d-8859-cdee0d1d6393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69dd221-d578-4fa0-ad8c-acffa02a3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69dd221-d578-4fa0-ad8c-acffa02a3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-620679122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184cd2c6-4ed0-4011-9aee-c3b29c0b35ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0f3ad722-2cb2-4e5b-94f8-3d58dc004243,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:49Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e4ccab-4135-4d20-9973-d19ee5fb376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e4ccab-4135-4d20-9973-d19ee5fb376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0dad18-dfb4-4cc5-b32b-20ccb8433aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0dad18-dfb4-4cc5-b32b-20ccb8433aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '184cd2c6-4ed0-4011-9aee-c3b29c0b35ff', 'volume_name': 'volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff', 'volume_size': 1, 'source_volid': '0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'source_volstatus': 'available'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c9d769-5195-4f7b-9d0e-4665c0a86ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c9d769-5195-4f7b-9d0e-4665c0a86ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4be4fc-ebca-4af5-84c0-6f27d6d87211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Volume 184cd2c6-4ed0-4011-9aee-c3b29c0b35ff: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff', 'volume_size': 1, 'source_volid': '0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'source_volstatus': 'available'} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:49 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 Jul 23 03:29:49 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:49 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" returned: 0 in 0.294s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.890s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342380799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a714a2-da7f-48d3-ab86-e60eff0ce515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume 91a714a2-da7f-48d3-ab86-e60eff0ce515 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:49 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2aad3e-a111-489d-8038-ee0cba737115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f3758-4f0e-4a57-a79a-6b1b955186b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:49 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 1073741824 Jul 23 03:29:49 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 (c31bb65b-3b0a-45f0-aaf5-e2f264e28350): created successfully Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f3758-4f0e-4a57-a79a-6b1b955186b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (5afb4d28-0e47-4e95-86e8-41570169639b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c479c96c-01a6-47df-ae62-eb778f4ca6b5 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:50 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 1073741824" returned: 0 in 0.635s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:50 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 Jul 23 03:29:50 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:50 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515" returned: 0 in 0.338s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.602s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f9a826-c873-4b09-9187-4b6cc4ec31c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a714a2-da7f-48d3-ab86-e60eff0ce515', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed039d6-1f7e-49e3-a14d-778be94cdd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Creating offline snapshot e0adc4cb-abff-4481-8f3c-614d78827380 of volume b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 (91a714a2-da7f-48d3-ab86-e60eff0ce515): created successfully Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed039d6-1f7e-49e3-a14d-778be94cdd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (1f09c2a9-6eb6-4783-bb9a-d45d43470eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b7b89f-73ed-4f46-ace5-adb34862c164]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a24e9809-9edf-4fe0-8520-1994b9a34241 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:50 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:29:50 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:51 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.644s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:51 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 1G Jul 23 03:29:51 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:51 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 1G" returned: 0 in 0.460s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055cefc-9187-4870-9064-68b942c7dbc5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:51 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055cefc-9187-4870-9064-68b942c7dbc5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:29:51 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:51 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055cefc-9187-4870-9064-68b942c7dbc5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.316s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:51 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 is being set with open permissions: ugo+rw Jul 23 03:29:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:52 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:29:52 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:52 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.304s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=153,cinder:UPDATE=179,cinder:DELETE=15,cinder:INSERT=51 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:52 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info Jul 23 03:29:52 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:52 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:52 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info is being set with open permissions: ugo+rw Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:52 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info Jul 23 03:29:52 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:52 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.info" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.715s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057947450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc20824-36c8-4516-adcd-ebe1703d9b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:47Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume cdc20824-36c8-4516-adcd-ebe1703d9b04 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:52 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:52 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 1073741824 Jul 23 03:29:52 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae279b8f-6ba4-45b6-92db-cadf6030f013 tempest-VolumesSnapshotTestJSON-800927785 None] Create snapshot completed successfully Jul 23 03:29:53 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 1073741824" returned: 0 in 0.531s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:53 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 Jul 23 03:29:53 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:53 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.072s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562537285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38ca36e39a34ea69375d65ccc9641ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:47Z,use_quota=True,user_id='20dad23389e142e8b7afee7a51656a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Creating volume 3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:53 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 1073741824 Jul 23 03:29:53 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3de18a5-895a-441b-96d8-65a68d858227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc20824-36c8-4516-adcd-ebe1703d9b04', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18594967-1d68-449d-9aa5-88099142cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 (cdc20824-36c8-4516-adcd-ebe1703d9b04): created successfully Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18594967-1d68-449d-9aa5-88099142cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (ad833a3d-e42a-4aa2-91d5-757341f68e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ee0ad4b0-7749-4cc4-8121-0bddffcaa0ba tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:54 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 1073741824" returned: 0 in 0.523s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:54 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 Jul 23 03:29:54 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:54 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" returned: 0 in 0.288s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.509s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:54 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Cloning volume 0f3ad722-2cb2-4e5b-94f8-3d58dc004243 to volume 184cd2c6-4ed0-4011-9aee-c3b29c0b35ff Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdee16-0399-4520-bca4-0b28be76ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4777e4e8-ab40-495e-ac1d-f71e93f025fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Volume volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 (3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297): created successfully Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4777e4e8-ab40-495e-ac1d-f71e93f025fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Flow 'volume_create_manager' (950f1d17-1e77-4081-a2ef-70fadac18bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Creating offline snapshot 3e9cd96a-6672-4afb-ac80-71a26b79cb56 of volume 0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c1b3f-e0bb-4466-a812-682f7cb4824f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-576143bc-6468-4f85-a170-bb155c2a687d tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created volume successfully. Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (1ef25752-92c3-4657-969a-64b2963185d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11c39d9-7015-4e1b-9aec-73f0f9e98270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11c39d9-7015-4e1b-9aec-73f0f9e98270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1197487530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0265cb2b-a3f6-49da-95d0-c32abd4d7be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e0adc4cb-abff-4481-8f3c-614d78827380,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:55Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f523f51-64c1-4c69-a3a5-4543d0ae80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f523f51-64c1-4c69-a3a5-4543d0ae80a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e1c23-0449-4f6c-a3df-f7fac624818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e1c23-0449-4f6c-a3df-f7fac624818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0265cb2b-a3f6-49da-95d0-c32abd4d7be8', 'volume_name': 'volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8', 'volume_size': 2, 'snapshot_id': 'e0adc4cb-abff-4481-8f3c-614d78827380'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e352e313-2c5c-40b9-8cc8-bd051b37aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e352e313-2c5c-40b9-8cc8-bd051b37aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb604f7b-b8e7-4046-9d25-43a1ea2ac046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Volume 0265cb2b-a3f6-49da-95d0-c32abd4d7be8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8', 'volume_size': 2, 'snapshot_id': 'e0adc4cb-abff-4481-8f3c-614d78827380'} Jul 23 03:29:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:55 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.405s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:55 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 1G Jul 23 03:29:55 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" acquired by "delete_volume" :: waited 0.055s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d94f6e-f1ce-4ecc-b934-cb7f2943bbff]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:55 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 1G" returned: 0 in 0.663s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:55 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:29:55 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:55 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 Jul 23 03:29:55 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 is being set with open permissions: ugo+rw Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:29:56 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" returned: 0 in 0.441s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297 Jul 23 03:29:56 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info Jul 23 03:29:56 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297" released by "delete_volume" :: held 0.769s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['a7049410-75e7-4469-a022-8693c576d42b', '6c7a6679-26d1-49e4-812e-4b66d63159b3', '5bd21708-85c9-492d-b8b9-601fac0fff09', 'f3c53e98-a1a6-40cc-8b3a-4fec5efac914'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:56 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info is being set with open permissions: ugo+rw Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-cdc20824-36c8-4516-adcd-ebe1703d9b04-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-cdc20824-36c8-4516-adcd-ebe1703d9b04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:56 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info Jul 23 03:29:56 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-cdc20824-36c8-4516-adcd-ebe1703d9b04" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-cdc20824-36c8-4516-adcd-ebe1703d9b04" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[134bca43-1db4-4eaa-baf3-730f170b2bdf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.354s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-cacf0dfe-6230-41c1-9853-64de4846f544 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-3c39bf1c-1db5-4fa1-8b4b-618e8f2a9297-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:57 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 Jul 23 03:29:57 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.info" returned: 0 in 0.335s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] snapshot: 3e9cd96a-6672-4afb-ac80-71a26b79cb56, volume: 184cd2c6-4ed0-4011-9aee-c3b29c0b35ff, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bba4fc-e6a7-4c37-a655-40710e7ef748]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:29:57 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04" returned: 0 in 0.550s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04 Jul 23 03:29:57 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.517s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e4ecd-6323-499f-8eef-86f266e79bb6]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-cdc20824-36c8-4516-adcd-ebe1703d9b04" returned: 0 in 0.291s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-cdc20824-36c8-4516-adcd-ebe1703d9b04" released by "delete_volume" :: held 0.888s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:57 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:29:57 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['0716c763-6988-4a39-9536-bfe653228e45', '7aad5ba1-e67f-4807-b75d-717ac0f8a46a', 'b7951fb3-7ca2-48e3-8530-2edb10bc509f', '500b21ef-04ea-45e5-8df8-f8c3cb50d208'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:58 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-91a714a2-da7f-48d3-ab86-e60eff0ce515-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-91a714a2-da7f-48d3-ab86-e60eff0ce515-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-91a714a2-da7f-48d3-ab86-e60eff0ce515" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-91a714a2-da7f-48d3-ab86-e60eff0ce515" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:58 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.472s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef97f5-61ae-4986-a19f-67519fe878fc]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff Jul 23 03:29:58 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:58 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 Jul 23 03:29:58 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:58 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.350s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:58 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae3efe4a-ebce-481b-b50d-535275b2b110 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-cdc20824-36c8-4516-adcd-ebe1703d9b04-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:58 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515" returned: 0 in 0.411s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515 Jul 23 03:29:58 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:59 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-91a714a2-da7f-48d3-ab86-e60eff0ce515" returned: 0 in 0.432s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-91a714a2-da7f-48d3-ab86-e60eff0ce515" released by "delete_volume" :: held 0.924s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['bcb0816b-c701-4dfb-8a2a-78a148ee0b0f', 'd4a49d4b-d806-4193-9bbb-f66595732d3b', '8022a5a0-79ab-480a-ad19-2b2f432780eb', '61e96c20-ae16-4609-a514-cbaff83251ae'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:59 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:29:59 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:00 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.801s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f36f9e0f-be8e-4133-a95c-713e6b065117 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-91a714a2-da7f-48d3-ab86-e60eff0ce515-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-c31bb65b-3b0a-45f0-aaf5-e2f264e28350-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-c31bb65b-3b0a-45f0-aaf5-e2f264e28350-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" acquired by "delete_volume" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a751f38-c61d-454d-bbdb-2c1be55e5314]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:01 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 Jul 23 03:30:01 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:01 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" returned: 0 in 0.937s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:02 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350 Jul 23 03:30:02 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:02 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" returned: 0 in 0.764s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-c31bb65b-3b0a-45f0-aaf5-e2f264e28350" released by "delete_volume" :: held 1.867s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:02 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['a5ce2a03-38f4-4e32-ba43-c81955fb432a', '654bff46-2fe5-4a46-a891-4fd836bb2c6c', '9c42fbc5-ccdc-4b0b-89dd-4a603e132f26', '57d52942-ba38-4824-8d1d-14b2180912c6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:03 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:03 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c07bb-154e-49f9-b1e3-329b40ad729c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:03 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b Jul 23 03:30:03 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:03 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.946s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:03 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d6e25db0-f394-42b2-bff6-d464b80ec5d6 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-c31bb65b-3b0a-45f0-aaf5-e2f264e28350-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:04 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" returned: 0 in 0.765s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:04 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:04 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" returned: 0 in 6.223s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:04 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8bb0ec-d55f-4292-8448-81df1da31dd9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:04 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:30:04 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:04 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" returned: 0 in 0.416s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b" released by "delete_volume" :: held 1.279s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['84ad4b8d-b655-4977-b278-9cea5fe3d1d0', '3029c504-f83a-4863-8a7d-4a0d26609a77', '3a1d0d04-893c-4934-9d2b-17534d778c36', '2f318eed-11ff-463a-9192-2b1dcaa2947f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:05 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:05 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.733s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:05 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Converted 1024.00 MB image at 164.44 MB/s Jul 23 03:30:05 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff is being set with open permissions: ugo+rw Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff Jul 23 03:30:05 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:05 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.304s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-01ce9e49-9b70-4075-9362-300ed44f0aef tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-c0c5e9e8-c8ba-4cca-abec-645b537c3c4b-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:05 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" released by "_copy_volume_from_snapshot" :: held 8.324s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-3e9cd96a-6672-4afb-ac80-71a26b79cb56" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-3e9cd96a-6672-4afb-ac80-71a26b79cb56" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Deleting offline snapshot 3e9cd96a-6672-4afb-ac80-71a26b79cb56 of volume 0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] snapshot_file for this snap is: volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed995c72-e2aa-4c3d-9d1d-8880127acea3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:30:05 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-472084b9-3f69-49ae-939a-254eb646186d-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-472084b9-3f69-49ae-939a-254eb646186d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "cinder-quobyte-472084b9-3f69-49ae-939a-254eb646186d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-472084b9-3f69-49ae-939a-254eb646186d" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd7c63-091e-4b8f-a1e9-bf71c35aeb3f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.491s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:06 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d Jul 23 03:30:06 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8f5578-f701-4b6a-9bf1-06d7befa746b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:30:06 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d Jul 23 03:30:06 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.487s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:30:06 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-472084b9-3f69-49ae-939a-254eb646186d" returned: 0 in 0.362s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-quobyte-472084b9-3f69-49ae-939a-254eb646186d" released by "delete_volume" :: held 1.001s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Created reservations ['9e084e72-21cd-445f-8a6c-3c1a21ec9bf2', 'f128ecf2-d6f3-4312-8d5e-fa11b2ee93ec', 'e21ade9f-0a22-45f4-9985-953749be2c07', 'c153de30-3a26-48f6-89fb-6ab28b01a9bf'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:07 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:07 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:07 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.553s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:07 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56 Jul 23 03:30:07 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:07 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Deleted volume successfully. Jul 23 03:30:07 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243.3e9cd96a-6672-4afb-ac80-71a26b79cb56" returned: 0 in 0.313s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-3e9cd96a-6672-4afb-ac80-71a26b79cb56" released by "_delete_snapshot" :: held 2.038s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a2a9b4be-77c7-4f33-8277-3ca4805c05e3 tempest-CreateVolumesFromSourceVolumeTest-419295128 None] Lock "cinder-472084b9-3f69-49ae-939a-254eb646186d-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.938s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.705s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4be4fc-ebca-4af5-84c0-6f27d6d87211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff', 'volume_size': 1, 'source_volid': '0f3ad722-2cb2-4e5b-94f8-3d58dc004243', 'source_volstatus': 'available'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896f3002-0911-4777-9a10-fd8ea827c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Creating volume 0265cb2b-a3f6-49da-95d0-c32abd4d7be8 from snapshot e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Volume volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff (184cd2c6-4ed0-4011-9aee-c3b29c0b35ff): created successfully Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896f3002-0911-4777-9a10-fd8ea827c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (c8b41d66-2b88-4a3d-8859-cdee0d1d6393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] snapshot: e0adc4cb-abff-4481-8f3c-614d78827380, volume: 0265cb2b-a3f6-49da-95d0-c32abd4d7be8, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51f3fd97-ddf2-42c7-ac8b-81fa2c0cae6a tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ececfe-330a-4fc3-a07e-0b7232c50e8a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:07 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:30:07 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:08 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.458s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b055cefc-9187-4870-9064-68b942c7dbc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb113da-e8d9-45b8-8338-9ead1cbdbd12]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:08 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:30:08 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (302660ce-17b1-4781-937c-c106ce8bc683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:08 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13c0d55-76d9-4124-aa20-1e79c48170e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.516s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:08 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 Jul 23 03:30:08 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13c0d55-76d9-4124-aa20-1e79c48170e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1081850812',display_name='tempest-VolumesGetTest-Volume-1669256947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c3de9-8be3-475b-a7fc-54bb53260219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f99d8e7-b0a9-4761-9581-3e35d1da8c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f99d8e7-b0a9-4761-9581-3e35d1da8c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451c8123-b365-49bd-a407-677d6a408080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451c8123-b365-49bd-a407-677d6a408080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7c3de9-8be3-475b-a7fc-54bb53260219', 'volume_name': 'volume-5e7c3de9-8be3-475b-a7fc-54bb53260219', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcc8912-6cef-43a3-afd0-9671bd7da587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcc8912-6cef-43a3-afd0-9671bd7da587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e8720-206e-4676-ac93-53d029fab6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Volume 5e7c3de9-8be3-475b-a7fc-54bb53260219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7c3de9-8be3-475b-a7fc-54bb53260219', 'volume_size': 1} Jul 23 03:30:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:14 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" returned: 0 in 5.686s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[974c9cc0-9f89-4e6d-9e86-f3eb20dae424]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:14 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:30:14 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Flow 'volume_create_manager' (363c8d7c-ab87-466d-8112-88f7c95bee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3934eef-9a2b-4c0e-91e0-aed8662c5927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3934eef-9a2b-4c0e-91e0-aed8662c5927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1485592742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cacc2-6b07-4a9c-ae9f-4c508125957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ca8177e10c4fbcb1ba08f8d8760aa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:15Z,use_quota=True,user_id='5bfe14394fae4f488d31e959022c3e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f75ce13-dd23-46f0-86c9-4d8e66af67d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f75ce13-dd23-46f0-86c9-4d8e66af67d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6022d5-da64-4b0f-88db-53806e32d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6022d5-da64-4b0f-88db-53806e32d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8cacc2-6b07-4a9c-ae9f-4c508125957c', 'volume_name': 'volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997d5a2b-267b-4376-9ab2-92a907b7f0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997d5a2b-267b-4376-9ab2-92a907b7f0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028d5c89-a337-429c-863c-bffa44282554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Volume 9e8cacc2-6b07-4a9c-ae9f-4c508125957c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c', 'volume_size': 1} Jul 23 03:30:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:15 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.642s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:15 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Converted 1024.00 MB image at 180.05 MB/s Jul 23 03:30:15 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 is being set with open permissions: ugo+rw Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 Jul 23 03:30:15 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" released by "_copy_volume_from_snapshot" :: held 7.709s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" released by "_create_volume_from_snapshot" :: held 7.754s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.790s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.568s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1081850812',display_name='tempest-VolumesGetTest-Volume-1669256947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c3de9-8be3-475b-a7fc-54bb53260219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Creating volume 5e7c3de9-8be3-475b-a7fc-54bb53260219 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:15 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 1073741824 Jul 23 03:30:15 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb604f7b-b8e7-4046-9d25-43a1ea2ac046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8', 'volume_size': 2, 'snapshot_id': 'e0adc4cb-abff-4481-8f3c-614d78827380'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5a8e7-891a-41dd-b0ea-775fbb6535d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Volume volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 (0265cb2b-a3f6-49da-95d0-c32abd4d7be8): created successfully Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5a8e7-891a-41dd-b0ea-775fbb6535d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (1ef25752-92c3-4657-969a-64b2963185d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b2c187bf-3e14-40e7-ba0e-de91e9d79a25 tempest-VolumesSnapshotTestJSON-800927785 None] Created volume successfully. Jul 23 03:30:15 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 1073741824" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 Jul 23 03:30:16 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:16 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1485592742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cacc2-6b07-4a9c-ae9f-4c508125957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ca8177e10c4fbcb1ba08f8d8760aa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:15Z,use_quota=True,user_id='5bfe14394fae4f488d31e959022c3e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Creating volume 9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:16 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e8720-206e-4676-ac93-53d029fab6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7c3de9-8be3-475b-a7fc-54bb53260219', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3fb7b-e658-4548-8db4-0c42163f64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:16 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c 1073741824 Jul 23 03:30:16 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Volume volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 (5e7c3de9-8be3-475b-a7fc-54bb53260219): created successfully Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3fb7b-e658-4548-8db4-0c42163f64a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (302660ce-17b1-4781-937c-c106ce8bc683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-66ad6857-210c-400e-98bc-078cf825d8f9 tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-0265cb2b-a3f6-49da-95d0-c32abd4d7be8-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-0265cb2b-a3f6-49da-95d0-c32abd4d7be8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf37f4f-0527-4f65-aab3-b50f46a268f5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-5e7c3de9-8be3-475b-a7fc-54bb53260219-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "cinder-5e7c3de9-8be3-475b-a7fc-54bb53260219-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-5e7c3de9-8be3-475b-a7fc-54bb53260219" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:17 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 Jul 23 03:30:17 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c 1073741824" returned: 0 in 0.797s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-5e7c3de9-8be3-475b-a7fc-54bb53260219" acquired by "delete_volume" :: waited 0.036s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c74be-3f2a-40a4-b75d-063133b0c44f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:17 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 Jul 23 03:30:17 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" returned: 0 in 0.669s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.513s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028d5c89-a337-429c-863c-bffa44282554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7d6dbf-6aa7-4445-ac18-a68a389e4b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Volume volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c (9e8cacc2-6b07-4a9c-ae9f-4c508125957c): created successfully Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7d6dbf-6aa7-4445-ac18-a68a389e4b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Flow 'volume_create_manager' (363c8d7c-ab87-466d-8112-88f7c95bee3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219" returned: 0 in 0.696s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dd8a66b4-3889-47b5-91b1-ee252011ff9f tempest-VolumeDependencyTests-1105833069 None] Created volume successfully. Jul 23 03:30:17 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219 Jul 23 03:30:17 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" returned: 0 in 0.496s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-0265cb2b-a3f6-49da-95d0-c32abd4d7be8" released by "delete_volume" :: held 1.265s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['c4e06832-1363-493d-8f42-aa4880ee5fc4', '854fc3c3-7ea3-4810-bbd2-49fe8b9172c8', 'b7fc1541-c227-4f4e-9a66-4e10d15c78f9', '9318b323-1c10-47d2-89ba-939139b02d19'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:18 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5e7c3de9-8be3-475b-a7fc-54bb53260219" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-5e7c3de9-8be3-475b-a7fc-54bb53260219" released by "delete_volume" :: held 1.159s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:18 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Created reservations ['30571b90-f3ec-4ef0-b385-2973eca0490a', '0ee2fdff-d1f6-4739-98ce-84772fa700a3', '17d2ff04-e74d-46ae-ac53-d1970d4d5dac', 'd2f7bec7-d9a5-4c5a-af25-57a17bb41e2c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Creating offline snapshot 459c128e-927a-405e-91fd-9856b19f3b10 of volume 9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c17e98-cc1a-4028-a0a9-b2e746bab373]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:18 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:18 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.510s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Deleted volume successfully. Jul 23 03:30:18 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1bbddabb-df31-4c61-abaf-0f9437dbe14d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-0265cb2b-a3f6-49da-95d0-c32abd4d7be8-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:19 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.420s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.534s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:30:19 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 1G Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-22eef089-c39c-4e06-a1a4-ff9932dc07b1 tempest-VolumesGetTest-998552848 None] Lock "cinder-5e7c3de9-8be3-475b-a7fc-54bb53260219-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:19 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-e0adc4cb-abff-4481-8f3c-614d78827380-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-e0adc4cb-abff-4481-8f3c-614d78827380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Deleting offline snapshot e0adc4cb-abff-4481-8f3c-614d78827380 of volume b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] snapshot_file for this snap is: volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a32e288-553c-448a-a5d3-8486e43e12f4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "cinder-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:19 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:30:19 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e779412-ec49-45b5-b8b4-15c4985cbfcf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 1G" returned: 0 in 0.735s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff Jul 23 03:30:19 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:19 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.577s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b055cefc-9187-4870-9064-68b942c7dbc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d0a577-f044-4855-bba4-7135ec29be92]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" returned: 0 in 0.496s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:30:20 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff Jul 23 03:30:20 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.506s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 is being set with open permissions: ugo+rw Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:20 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.503s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" returned: 0 in 0.353s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:30:20 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff" released by "delete_volume" :: held 0.912s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Created reservations ['75dc452b-2d23-4ef9-81a9-2f3593d3177c', 'f5596961-d86d-4223-8aba-1b7d831c02d0', '2181b9ea-d087-4b03-b203-2583ef67bb89', 'ddf954eb-082f-40ed-86da-b92f18a7cc76'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:20 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.476s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info Jul 23 03:30:20 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:21 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:21 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.821s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380 Jul 23 03:30:21 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:21 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info" returned: 0 in 0.513s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info is being set with open permissions: ugo+rw Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info Jul 23 03:30:21 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:21 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.581s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-93dd1895-420a-416d-b9bf-62e6364bd6ad tempest-VolumesGetTest-998552848 None] Lock "cinder-184cd2c6-4ed0-4011-9aee-c3b29c0b35ff-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:21 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5.e0adc4cb-abff-4481-8f3c-614d78827380" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-e0adc4cb-abff-4481-8f3c-614d78827380" released by "_delete_snapshot" :: held 2.474s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" released by "delete_snapshot" :: held 2.517s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['ba6e6c75-decc-4a92-b21c-4b6a096e3946', 'aab33bc3-94ac-4639-a5fe-a4594cf71c0c', '5125c235-f906-4687-828e-7e0e85a7cd79', '3f8379d0-acae-4423-bc46-ab9df8d576eb'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:21 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.info" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.590s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-0f3ad722-2cb2-4e5b-94f8-3d58dc004243-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "cinder-0f3ad722-2cb2-4e5b-94f8-3d58dc004243-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-00a4c41e-770f-41eb-b2ae-1ef7436262db tempest-VolumeDependencyTests-1105833069 None] Create snapshot completed successfully Jul 23 03:30:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Delete snapshot completed successfully. Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7e3669dc-6bbc-4097-be96-61bf71c24fa3 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-e0adc4cb-abff-4481-8f3c-614d78827380-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[521991b9-1520-4745-ab02-5aaece307f43]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:22 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:30:22 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-b055cefc-9187-4870-9064-68b942c7dbc5-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-b055cefc-9187-4870-9064-68b942c7dbc5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd244571-f05f-41a6-b557-e45f4a4d7350]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:22 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.495s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:22 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243 Jul 23 03:30:22 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:22 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:30:22 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-0f3ad722-2cb2-4e5b-94f8-3d58dc004243" released by "delete_volume" :: held 0.897s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Created reservations ['097df84a-12c6-4db2-8d7b-37d9bb538024', 'cf502416-722a-4daf-864d-ddeabaf4a9d2', '969def60-5e8e-4fe9-aaff-9ba50b0f0309', '576556cb-5946-46bb-8205-3e64908bfb7a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:23 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:23 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.633s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5 Jul 23 03:30:23 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Flow 'volume_create_manager' (69fee464-6151-4e03-9b39-5870f823e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a620a-7146-49a9-9450-8ab8bc13779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a620a-7146-49a9-9450-8ab8bc13779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1704597044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2477d4eb-813b-48e5-bf13-a66b40f22c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ca8177e10c4fbcb1ba08f8d8760aa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=459c128e-927a-405e-91fd-9856b19f3b10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:23Z,use_quota=True,user_id='5bfe14394fae4f488d31e959022c3e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f283390a-ccad-429e-926a-3da593ddd6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f283390a-ccad-429e-926a-3da593ddd6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a944f4e5-302f-48c0-91a9-4203b0e6c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a944f4e5-302f-48c0-91a9-4203b0e6c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2477d4eb-813b-48e5-bf13-a66b40f22c26', 'volume_name': 'volume-2477d4eb-813b-48e5-bf13-a66b40f22c26', 'volume_size': 1, 'snapshot_id': '459c128e-927a-405e-91fd-9856b19f3b10'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2425a1-65e2-4d24-ab3c-827a6993b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2425a1-65e2-4d24-ab3c-827a6993b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c6f0de-617f-4ee7-a472-fed88c1d7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:23 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Volume 2477d4eb-813b-48e5-bf13-a66b40f22c26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2477d4eb-813b-48e5-bf13-a66b40f22c26', 'volume_size': 1, 'snapshot_id': '459c128e-927a-405e-91fd-9856b19f3b10'} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10-2477d4eb-813b-48e5-bf13-a66b40f22c26" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10-2477d4eb-813b-48e5-bf13-a66b40f22c26" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Creating volume 2477d4eb-813b-48e5-bf13-a66b40f22c26 from snapshot 459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] snapshot: 459c128e-927a-405e-91fd-9856b19f3b10, volume: 2477d4eb-813b-48e5-bf13-a66b40f22c26, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:23 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.422s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[430c465a-308b-4f48-920f-110b2bae5c43]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:23 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b055cefc-9187-4870-9064-68b942c7dbc5" returned: 0 in 0.442s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-b055cefc-9187-4870-9064-68b942c7dbc5" released by "delete_volume" :: held 1.178s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9d9d4a9f-c20c-4eef-8456-6bcf1db1f393 tempest-VolumesGetTest-998552848 None] Lock "cinder-0f3ad722-2cb2-4e5b-94f8-3d58dc004243-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:23 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:23 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['368258a6-a608-478b-937a-2d2598f93968', '33df0902-c7cf-4ec2-9462-e548ed610f15', '54b87c78-8973-4903-b2d1-c18135e211c7', '9c5e7495-a534-4583-b3c8-0407f662b410'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:24 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:24 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.520s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[59601b6f-8d4a-4e84-9170-97877a534287]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.318s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Deleted volume successfully. Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-00965342-3f4a-46f7-a510-a46d803d6d6c tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-b055cefc-9187-4870-9064-68b942c7dbc5-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:24 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:24 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:24 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.470s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:30:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 Jul 23 03:30:24 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (6b3e761c-fd6e-409f-85a0-73853711eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8dbe78-2df0-43f2-b969-ae6a1134c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8dbe78-2df0-43f2-b969-ae6a1134c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1522912203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:27Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0a060-0119-4243-8c62-37e6b52fbd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0a060-0119-4243-8c62-37e6b52fbd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfec5318-30e7-4bb7-b6c2-13d80d150ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (d92a265b-0b3d-407c-af6a-853433dcb865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75cd36-fda8-439a-a886-234bf440381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75cd36-fda8-439a-a886-234bf440381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-458080060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615dc477-c751-4580-9c8c-0df25abff376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:28Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba3e245-9b50-4611-8791-e955fa5057ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba3e245-9b50-4611-8791-e955fa5057ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e48b00d-b9d9-40a3-afdc-a9ecc13777d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e48b00d-b9d9-40a3-afdc-a9ecc13777d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615dc477-c751-4580-9c8c-0df25abff376', 'volume_name': 'volume-615dc477-c751-4580-9c8c-0df25abff376', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488ab9e9-9c53-46c1-967b-fea0a72277b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488ab9e9-9c53-46c1-967b-fea0a72277b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8207f88-b06f-4c02-934e-ee47ca3e790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Volume 615dc477-c751-4580-9c8c-0df25abff376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615dc477-c751-4580-9c8c-0df25abff376', 'volume_size': 1} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfec5318-30e7-4bb7-b6c2-13d80d150ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c', 'volume_name': 'volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151a0fdd-c897-43d6-bbb2-f30237a7b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151a0fdd-c897-43d6-bbb2-f30237a7b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632dd08e-4a57-4840-a062-f4d88eb8d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:30:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Trying to clone 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 at location (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:30:30 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD, size 20.69 MB, duration 1.17 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:30:30 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Image download 20.69 MB at 17.68 MB/s Jul 23 03:30:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32dafda-8a33-44c3-9239-db3e1b6ab689]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:30 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD Jul 23 03:30:30 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:31 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD" returned: 0 in 1.339s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:31 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 is fetched for user 6cfbdd27bd5b4a8cb86904df1aae6ffd. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:30:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047ce10-df25-4639-be7e-94a7267611c3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:32 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD Jul 23 03:30:32 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:32 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26" returned: 0 in 8.112s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0eaab3-cd93-407c-8a77-68e50a460c17]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD" returned: 0 in 1.018s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:33 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:33 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:33 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.568s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:33 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Converted 1024.00 MB image at 126.20 MB/s Jul 23 03:30:33 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 is being set with open permissions: ugo+rw Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 Jul 23 03:30:33 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:33 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26" returned: 0 in 0.263s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" released by "_copy_volume_from_snapshot" :: held 10.151s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10-2477d4eb-813b-48e5-bf13-a66b40f22c26" released by "_create_volume_from_snapshot" :: held 10.196s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.215s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.603s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-458080060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615dc477-c751-4580-9c8c-0df25abff376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:28Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Creating volume 615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 1073741824 Jul 23 03:30:33 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c6f0de-617f-4ee7-a472-fed88c1d7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2477d4eb-813b-48e5-bf13-a66b40f22c26', 'volume_size': 1, 'snapshot_id': '459c128e-927a-405e-91fd-9856b19f3b10'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5472f9-10c6-4268-9e10-b08aa2574330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Volume volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 (2477d4eb-813b-48e5-bf13-a66b40f22c26): created successfully Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5472f9-10c6-4268-9e10-b08aa2574330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Flow 'volume_create_manager' (69fee464-6151-4e03-9b39-5870f823e548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7d7ed0cc-0e8f-4a68-b417-c76080086235 tempest-VolumeDependencyTests-1105833069 None] Created volume successfully. Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-459c128e-927a-405e-91fd-9856b19f3b10-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-459c128e-927a-405e-91fd-9856b19f3b10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Deleting offline snapshot 459c128e-927a-405e-91fd-9856b19f3b10 of volume 9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] snapshot_file for this snap is: volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ce2738-fff3-498d-9f65-71cd561f8909]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:34 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 1073741824" returned: 0 in 0.590s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:34 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.443s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[71de4880-7d26-445d-935c-2427470ab911]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1522912203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:27Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Creating volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:34 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8207f88-b06f-4c02-934e-ee47ca3e790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615dc477-c751-4580-9c8c-0df25abff376', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:34 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1073741824 Jul 23 03:30:34 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b8fee8-1ce3-4d6d-8386-2973eccd48ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Volume volume-615dc477-c751-4580-9c8c-0df25abff376 (615dc477-c751-4580-9c8c-0df25abff376): created successfully Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b8fee8-1ce3-4d6d-8386-2973eccd48ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (d92a265b-0b3d-407c-af6a-853433dcb865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:34 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:34 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b6e5e3eb-4389-4cd5-8c77-0d51c733fceb tempest-VolumesSnapshotTestJSON-800927785 None] Created volume successfully. Jul 23 03:30:35 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:35 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1073741824" returned: 0 in 0.569s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c Jul 23 03:30:35 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.494s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" returned: 0 in 0.323s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:35 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10 Jul 23 03:30:35 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Attempting download of 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:35 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Creating offline snapshot a180cc52-9e26-422c-9dda-0ade0ee707dc of volume 615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50c687-5192-4194-ba88-fe9af283b02e]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dedc97c-0ba9-4a45-ac05-190fb8ac0184]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:36 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v Jul 23 03:30:36 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c.459c128e-927a-405e-91fd-9856b19f3b10" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:36 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-459c128e-927a-405e-91fd-9856b19f3b10" released by "_delete_snapshot" :: held 1.951s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" released by "delete_snapshot" :: held 1.987s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:36 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.444s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Created reservations ['48e9412f-db5a-45ce-bf2f-4d0d19db91f6', 'ff0270d9-8680-4df6-9c54-d7d343531048', '2b900369-f468-4a3c-9fb3-1056bf3a9210', '7ed0d155-4ee6-4b1e-aaeb-66e1ea49c68c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Delete snapshot completed successfully. Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8c14cfb1-f48a-4bff-a2ad-135ea41bb78f tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-459c128e-927a-405e-91fd-9856b19f3b10-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:36 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v" returned: 0 in 0.557s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:36 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.612s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:36 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc 1G Jul 23 03:30:36 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v Jul 23 03:30:36 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v" returned: 1 in 0.491s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_djpkkq0v' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4c488-58e2-4bd1-90dc-3e3d00a78eea]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc 1G" returned: 0 in 0.482s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-615dc477-c751-4580-9c8c-0df25abff376 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-615dc477-c751-4580-9c8c-0df25abff376 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:37 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD Jul 23 03:30:37 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] 305f1036-a296-4b7a-ad9a-5bff6ecc6243 was qcow2, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-615dc477-c751-4580-9c8c-0df25abff376 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:37 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc is being set with open permissions: ugo+rw Jul 23 03:30:37 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c Jul 23 03:30:37 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:37 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-9e8cacc2-6b07-4a9c-ae9f-4c508125957c-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-9e8cacc2-6b07-4a9c-ae9f-4c508125957c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0197ad73-73dd-4784-8de1-3d202ec97014]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.275s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:37 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:37 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info Jul 23 03:30:37 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c Jul 23 03:30:37 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:38 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info" returned: 0 in 0.336s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:38 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info is being set with open permissions: ugo+rw Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:38 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info Jul 23 03:30:38 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:38 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-9e8cacc2-6b07-4a9c-ae9f-4c508125957c" released by "delete_volume" :: held 0.740s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Created reservations ['4f787c9e-0ae8-49f2-bdb9-18993c26be54', 'a6ecbb29-1157-419d-945b-434abced01a2', '6156c41e-e0af-43ac-942b-7b759efa654d', '43b0ed4b-b362-451c-a7f0-b1ffc6fc9215'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:38 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.info" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:38 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:38 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4c3097e3-65a6-456b-a953-aa2be64d5fd7 tempest-VolumesSnapshotTestJSON-800927785 None] Create snapshot completed successfully Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-2477d4eb-813b-48e5-bf13-a66b40f22c26-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-2477d4eb-813b-48e5-bf13-a66b40f22c26-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:38 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.363s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Deleted volume successfully. Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e47d1-fcb2-4e7f-84e7-019e26c027ad]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433f08dc-fa76-40f8-b0e4-89abb83deee1 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-9e8cacc2-6b07-4a9c-ae9f-4c508125957c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:38 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 Jul 23 03:30:38 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:39 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:39 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26 Jul 23 03:30:39 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:39 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" returned: 0 in 2.182s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_ab6yzu1mdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:39 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Converted 112.00 MB image at 51.31 MB/s Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:39 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1G Jul 23 03:30:39 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (ae854738-2731-4d09-af7e-01f9cde6ac45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1ff4cf-90b0-4fb2-93e6-2637553c7bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2477d4eb-813b-48e5-bf13-a66b40f22c26" returned: 0 in 0.384s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1ff4cf-90b0-4fb2-93e6-2637553c7bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922155916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c812ac0a-79bc-4ab0-98c8-ee1e36356350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde69a83ee6346f8a8cc7184b53d7c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a180cc52-9e26-422c-9dda-0ade0ee707dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:40Z,use_quota=True,user_id='95f87b277e784ef6a4b15276cf7f6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67e9d1d-6867-435c-996b-757cc77bf4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67e9d1d-6867-435c-996b-757cc77bf4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa35e892-d1fb-432c-89b9-d1d0b1ff05b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa35e892-d1fb-432c-89b9-d1d0b1ff05b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c812ac0a-79bc-4ab0-98c8-ee1e36356350', 'volume_name': 'volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350', 'volume_size': 1, 'snapshot_id': 'a180cc52-9e26-422c-9dda-0ade0ee707dc'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bf936a-dbb4-48cb-ac94-3f40c2f0c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bf936a-dbb4-48cb-ac94-3f40c2f0c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eae08f-17eb-428b-9340-fee87b00ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Volume c812ac0a-79bc-4ab0-98c8-ee1e36356350: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350', 'volume_size': 1, 'snapshot_id': 'a180cc52-9e26-422c-9dda-0ade0ee707dc'} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc-c812ac0a-79bc-4ab0-98c8-ee1e36356350" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-quobyte-2477d4eb-813b-48e5-bf13-a66b40f22c26" released by "delete_volume" :: held 1.041s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc-c812ac0a-79bc-4ab0-98c8-ee1e36356350" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Creating volume c812ac0a-79bc-4ab0-98c8-ee1e36356350 from snapshot a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] snapshot: a180cc52-9e26-422c-9dda-0ade0ee707dc, volume: c812ac0a-79bc-4ab0-98c8-ee1e36356350, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca31d8d-71bd-4864-a0e3-4eb449e1de0a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Created reservations ['9f5f4bbb-bd98-4dc0-8520-670690e8a500', '5e6f88c4-967a-40db-ac26-de5b5364425a', 'c5728e00-83c1-4f62-a28e-36306b022b27', '6509ca63-8148-4979-a819-e7b23592f592'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:39 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c 1G" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Downloaded image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 for user 6cfbdd27bd5b4a8cb86904df1aae6ffd is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Marking volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Copying metadata from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 to 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:30:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Creating volume glance metadata for volume 5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c backed by image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:40 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:40 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:40 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:40 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632dd08e-4a57-4840-a062-f4d88eb8d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e05cfd3-933e-4ba4-a65f-d5e82e672b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:40 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Volume volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c (5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c): created successfully Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e05cfd3-933e-4ba4-a65f-d5e82e672b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (6b3e761c-fd6e-409f-85a0-73853711eda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-adeec787-eb50-4947-8543-efc2911817be tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:30:40 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.294s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Deleted volume successfully. Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4ace14d-cf8c-45fd-b0c9-d211f8a41b65 tempest-VolumeDependencyTests-1105833069 None] Lock "cinder-2477d4eb-813b-48e5-bf13-a66b40f22c26-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:40 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.453s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-615dc477-c751-4580-9c8c-0df25abff376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ff79a-7fdd-4a30-b5b0-9169b0434bb8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:40 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:40 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:40 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.434s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:30:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:40 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 Jul 23 03:30:40 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (fecd6860-b635-490b-a5b7-10c673bae682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242b12d1-620f-4dee-8280-fd28530af81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242b12d1-620f-4dee-8280-fd28530af81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2121319411',display_name='tempest-VolumesGetTest-Volume-1781510757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e64aeb-c8b3-4545-abdd-476f6f637729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:42Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db82b5ce-db2d-4fed-b849-0bff9d281b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db82b5ce-db2d-4fed-b849-0bff9d281b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3d5115-a83c-4657-bea3-d1e02469b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3d5115-a83c-4657-bea3-d1e02469b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e64aeb-c8b3-4545-abdd-476f6f637729', 'volume_name': 'volume-f0e64aeb-c8b3-4545-abdd-476f6f637729', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39377187-799e-4c1f-901f-c5238f9f37c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39377187-799e-4c1f-901f-c5238f9f37c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b87a83-f0bf-4135-933a-1b48e103f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Volume f0e64aeb-c8b3-4545-abdd-476f6f637729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e64aeb-c8b3-4545-abdd-476f6f637729', 'volume_size': 1} Jul 23 03:30:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:46 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350" returned: 0 in 6.102s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbbce09-7f4f-4249-bdd4-94702ffe6b08]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:47 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:47 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:47 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.595s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:47 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Converted 1024.00 MB image at 167.79 MB/s Jul 23 03:30:47 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 is being set with open permissions: ugo+rw Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:47 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 Jul 23 03:30:47 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=120,cinder:UPDATE=179,cinder:DELETE=12,cinder:INSERT=44 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Flow 'volume_create_manager' (c0ed54bb-a3cb-48de-86ec-b267c54f9d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47d191b-91b7-434d-8d3d-ceaf1263fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47d191b-91b7-434d-8d3d-ceaf1263fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dea54d1-5f6e-4280-94ae-108efa2cfdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ee86aaf17f4d5697b4a289cd8d5bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:48Z,use_quota=True,user_id='b2e994aabd42428b88736fae6277b4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6243a8-ec11-4b0e-a5f8-0ea796cd3bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6243a8-ec11-4b0e-a5f8-0ea796cd3bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70931f3-e8b7-4063-bbe9-c9c116593d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70931f3-e8b7-4063-bbe9-c9c116593d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dea54d1-5f6e-4280-94ae-108efa2cfdf1', 'volume_name': 'volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654089e0-7824-4e2f-8200-7c718811a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654089e0-7824-4e2f-8200-7c718811a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bf4667-bf88-4370-b165-a10540bd303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Volume 2dea54d1-5f6e-4280-94ae-108efa2cfdf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1', 'volume_size': 1} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" released by "_copy_volume_from_snapshot" :: held 7.973s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc-c812ac0a-79bc-4ab0-98c8-ee1e36356350" released by "_create_volume_from_snapshot" :: held 8.006s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.036s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.857s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2121319411',display_name='tempest-VolumesGetTest-Volume-1781510757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e64aeb-c8b3-4545-abdd-476f6f637729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9433d4d3174798a5ce9314779eef80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:42Z,use_quota=True,user_id='6cfbdd27bd5b4a8cb86904df1aae6ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Creating volume f0e64aeb-c8b3-4545-abdd-476f6f637729 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:47 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:47 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 1073741824 Jul 23 03:30:47 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eae08f-17eb-428b-9340-fee87b00ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350', 'volume_size': 1, 'snapshot_id': 'a180cc52-9e26-422c-9dda-0ade0ee707dc'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b913ecd-5609-453d-a49c-792d00bd4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Volume volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 (c812ac0a-79bc-4ab0-98c8-ee1e36356350): created successfully Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b913ecd-5609-453d-a49c-792d00bd4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Flow 'volume_create_manager' (ae854738-2731-4d09-af7e-01f9cde6ac45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a3a0a026-26ca-4f10-98e0-298ff7eabe5d tempest-VolumesSnapshotTestJSON-800927785 None] Created volume successfully. Jul 23 03:30:48 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 1073741824" returned: 0 in 0.482s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:48 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 Jul 23 03:30:48 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:48 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729" returned: 0 in 0.282s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dea54d1-5f6e-4280-94ae-108efa2cfdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ee86aaf17f4d5697b4a289cd8d5bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:48Z,use_quota=True,user_id='b2e994aabd42428b88736fae6277b4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Creating volume 2dea54d1-5f6e-4280-94ae-108efa2cfdf1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:48 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:48 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 1073741824 Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b87a83-f0bf-4135-933a-1b48e103f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e64aeb-c8b3-4545-abdd-476f6f637729', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a8a63f-0cfb-4efd-a486-401a3e38eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Volume volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 (f0e64aeb-c8b3-4545-abdd-476f6f637729): created successfully Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a8a63f-0cfb-4efd-a486-401a3e38eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Flow 'volume_create_manager' (fecd6860-b635-490b-a5b7-10c673bae682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-18f19f82-c8ae-43eb-a2a8-d59b6a333659 tempest-VolumesGetTest-998552848 None] Created volume successfully. Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-c812ac0a-79bc-4ab0-98c8-ee1e36356350-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-c812ac0a-79bc-4ab0-98c8-ee1e36356350-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee91ef8-4f26-445a-bb90-2fc9d5cbbfbf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 Jul 23 03:30:49 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 1073741824" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 Jul 23 03:30:49 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350" returned: 0 in 0.465s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-f0e64aeb-c8b3-4545-abdd-476f6f637729-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:49 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350 Jul 23 03:30:49 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "cinder-f0e64aeb-c8b3-4545-abdd-476f6f637729-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-f0e64aeb-c8b3-4545-abdd-476f6f637729" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:49 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-f0e64aeb-c8b3-4545-abdd-476f6f637729" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bf4667-bf88-4370-b165-a10540bd303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ef97a-3918-49ef-b873-c36e6174ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eaffa1-35b8-4452-8980-4962ed66c009]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Volume volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 (2dea54d1-5f6e-4280-94ae-108efa2cfdf1): created successfully Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ef97a-3918-49ef-b873-c36e6174ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Flow 'volume_create_manager' (c0ed54bb-a3cb-48de-86ec-b267c54f9d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e170887f-d0f8-46f3-ba35-4a7012629f66 tempest-CinderUnicodeTest-184112596 None] Created volume successfully. Jul 23 03:30:49 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c812ac0a-79bc-4ab0-98c8-ee1e36356350" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 Jul 23 03:30:49 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-c812ac0a-79bc-4ab0-98c8-ee1e36356350" released by "delete_volume" :: held 0.919s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['456ef6f2-36b2-4b3c-9f44-1f32db7ea1e4', '25bb1a5e-6132-4c9a-abd6-062019973ffa', '85f2ded4-46a2-4f36-bb0c-620e0d65c2ff', 'd1d55003-73e3-4dcd-a7a4-78a129d17d7c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:50 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Flow 'volume_create_manager' (79c5d963-675b-4368-9dcf-0d60382b75af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446bea84-aadb-44d8-a354-b8024375c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446bea84-aadb-44d8-a354-b8024375c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-288870337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef3c580-f6f8-4ebe-aacf-bea6f9024264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea90e3d2a8b4244a37a6558138303d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:50Z,use_quota=True,user_id='cd0e5c0d17f34485a2e2fd365db3a8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6694a8b-5499-499f-b712-b700b139d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6694a8b-5499-499f-b712-b700b139d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6f3e9c-7294-40d8-b29c-3abd2ceca016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6f3e9c-7294-40d8-b29c-3abd2ceca016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef3c580-f6f8-4ebe-aacf-bea6f9024264', 'volume_name': 'volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a96c639-7030-43c2-9a48-1460e0a1b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a96c639-7030-43c2-9a48-1460e0a1b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2487955-97de-4ae8-be13-b245ad1b9860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Volume 2ef3c580-f6f8-4ebe-aacf-bea6f9024264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264', 'volume_size': 1} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-288870337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef3c580-f6f8-4ebe-aacf-bea6f9024264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea90e3d2a8b4244a37a6558138303d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:50Z,use_quota=True,user_id='cd0e5c0d17f34485a2e2fd365db3a8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Creating volume 2ef3c580-f6f8-4ebe-aacf-bea6f9024264 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:50 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-a180cc52-9e26-422c-9dda-0ade0ee707dc-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729" returned: 0 in 0.537s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 1073741824 Jul 23 03:30:50 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-a180cc52-9e26-422c-9dda-0ade0ee707dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:50 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729 Jul 23 03:30:50 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Deleting offline snapshot a180cc52-9e26-422c-9dda-0ade0ee707dc of volume 615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:50 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] snapshot_file for this snap is: volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc8e2ce-ca2a-49e7-8d62-febaaef3c79d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Deleted volume successfully. Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9141ced8-8dc4-42b9-a10a-c32ce661b2f7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-c812ac0a-79bc-4ab0-98c8-ee1e36356350-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:50 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:50 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0e64aeb-c8b3-4545-abdd-476f6f637729" returned: 0 in 0.327s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-f0e64aeb-c8b3-4545-abdd-476f6f637729" released by "delete_volume" :: held 0.953s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Created reservations ['e28ce1f6-cc23-4e19-8cbe-316143987d55', '092916bc-aa3b-4ac7-8364-690b091abb99', '016b5d6c-931f-450d-aa56-acd5667d2a02', 'bc07a02f-4988-4465-a8a0-7a15e46587b7'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:50 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.466s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-615dc477-c751-4580-9c8c-0df25abff376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 1073741824" returned: 0 in 0.637s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17df2af-95b8-4b9c-90ff-64f9f3fe95a2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 Jul 23 03:30:51 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:51 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.290s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8d0de7a7-10db-4d2c-8a25-a8efc9b4e81d tempest-VolumesGetTest-998552848 None] Lock "cinder-f0e64aeb-c8b3-4545-abdd-476f6f637729-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:51 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2487955-97de-4ae8-be13-b245ad1b9860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e127fcac-b4dd-4446-92e3-26abac7b3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Volume volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 (2ef3c580-f6f8-4ebe-aacf-bea6f9024264): created successfully Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e127fcac-b4dd-4446-92e3-26abac7b3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Flow 'volume_create_manager' (79c5d963-675b-4368-9dcf-0d60382b75af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-91fa85d2-d17b-429a-97c0-025cca58a9ff tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Created volume successfully. Jul 23 03:30:51 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.450s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:51 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Flow 'volume_create_manager' (63c501ff-af38-4d5e-8863-0034e3ebae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc46d547-f431-4469-87cc-ce154dbe8b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc46d547-f431-4469-87cc-ce154dbe8b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1344190362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6c9582-64cb-4123-8857-b51db37d0abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ee86aaf17f4d5697b4a289cd8d5bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:52Z,use_quota=True,user_id='b2e994aabd42428b88736fae6277b4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c82056-e5d8-4d19-8e81-a9d866fb6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c82056-e5d8-4d19-8e81-a9d866fb6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54f43f1-d873-4e0f-8531-942e99531c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54f43f1-d873-4e0f-8531-942e99531c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6c9582-64cb-4123-8857-b51db37d0abc', 'volume_name': 'volume-7f6c9582-64cb-4123-8857-b51db37d0abc', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574edb79-00d4-40c5-8a23-e4ec4d721d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574edb79-00d4-40c5-8a23-e4ec4d721d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87dd3e-04bb-438e-9fb3-a50d5f1fd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Volume 7f6c9582-64cb-4123-8857-b51db37d0abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6c9582-64cb-4123-8857-b51db37d0abc', 'volume_size': 1} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1344190362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6c9582-64cb-4123-8857-b51db37d0abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ee86aaf17f4d5697b4a289cd8d5bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:52Z,use_quota=True,user_id='b2e994aabd42428b88736fae6277b4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Creating volume 7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:51 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc 1073741824 Jul 23 03:30:51 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.401s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc Jul 23 03:30:51 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "cinder-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Acquiring lock "cinder-quobyte-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f550a8-1284-4cb1-895d-31f952b0d206]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376.a180cc52-9e26-422c-9dda-0ade0ee707dc" returned: 0 in 0.317s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-a180cc52-9e26-422c-9dda-0ade0ee707dc" released by "_delete_snapshot" :: held 1.795s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" released by "delete_snapshot" :: held 1.829s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c Jul 23 03:30:52 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:52 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['05fc1db7-5d0e-4d67-a699-98d91a8ab49f', 'e7f86dcf-235e-4559-a422-0fd8915ebd6f', 'ac3d10ba-39ed-49e6-a60e-eb76629558d0', '37d32273-75c2-4fe3-a6c3-75c2cd3d6ec9'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc 1073741824" returned: 0 in 0.642s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=147,cinder:DELETE=17,cinder:UPDATE=156,cinder:INSERT=51 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc Jul 23 03:30:52 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Delete snapshot completed successfully. Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9bf79a15-4c48-4e08-9af5-a39788cc90db tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-a180cc52-9e26-422c-9dda-0ade0ee707dc-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" returned: 0 in 0.487s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c Jul 23 03:30:52 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:52 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc" returned: 0 in 0.363s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87dd3e-04bb-438e-9fb3-a50d5f1fd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6c9582-64cb-4123-8857-b51db37d0abc', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1814c351-7804-4add-bb2d-a466ebd7dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:52 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Volume volume-7f6c9582-64cb-4123-8857-b51db37d0abc (7f6c9582-64cb-4123-8857-b51db37d0abc): created successfully Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1814c351-7804-4add-bb2d-a466ebd7dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Flow 'volume_create_manager' (63c501ff-af38-4d5e-8863-0034e3ebae8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-06cf4a6b-310b-481e-bf83-4a75c54fcf08 tempest-CinderUnicodeTest-184112596 None] Created volume successfully. Jul 23 03:30:52 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" returned: 0 in 0.295s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "cinder-quobyte-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c" released by "delete_volume" :: held 0.827s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Created reservations ['6b90e862-d472-4d6d-9d35-010ad4a7ea63', '6d8facb6-6adc-4d72-af75-3cb3cbcf94d2', '307f8d75-c49f-41de-ab4d-ba01598eea54', '70f01641-0d99-4e14-aefa-de65f7770b34'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:53 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:53 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:53 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.309s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Deleted volume successfully. Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f4d624c3-69a0-4b7c-82b2-c1c01ea7ea03 tempest-VolumesGetTest-998552848 None] Lock "cinder-5ca2dd5d-9dcd-40cd-adcc-9337f8937d5c-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-794cfd2d-d926-422f-b5ae-0f5f8f721fe1 req-aa3711ce-28b5-44c3-9784-9101fade5149 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-794cfd2d-d926-422f-b5ae-0f5f8f721fe1 req-aa3711ce-28b5-44c3-9784-9101fade5149 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-794cfd2d-d926-422f-b5ae-0f5f8f721fe1 req-aa3711ce-28b5-44c3-9784-9101fade5149 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-794cfd2d-d926-422f-b5ae-0f5f8f721fe1 req-aa3711ce-28b5-44c3-9784-9101fade5149 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f8e6a96-b136-4dfc-9317-0e4053296833', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-615dc477-c751-4580-9c8c-0df25abff376-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-615dc477-c751-4580-9c8c-0df25abff376-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-794cfd2d-d926-422f-b5ae-0f5f8f721fe1 req-aa3711ce-28b5-44c3-9784-9101fade5149 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] attachment_update completed successfully. Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f81c04-92dd-4c05-a1cb-ff0e2e65d65f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:53 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:53 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Creating offline snapshot 37cad24e-10e7-457e-a216-afc2ea03ed7a of volume 7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c75782-a98f-49a8-85a9-bc5c87f1f415]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.542s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376 Jul 23 03:30:54 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc Jul 23 03:30:54 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-615dc477-c751-4580-9c8c-0df25abff376" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-615dc477-c751-4580-9c8c-0df25abff376" released by "delete_volume" :: held 1.045s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:54 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc" returned: 0 in 0.579s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a 1G Jul 23 03:30:54 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['eda540bc-dd73-4afa-8979-d7e4ff544689', '958577c4-c931-4543-a95b-ee42822c9efb', 'd9b6a682-b46d-43a1-abe5-0372baf9f6ae', '5c4213bc-b76d-481d-88e6-f4ccca1aa6f7'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:55 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:55 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:55 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.356s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Deleted volume successfully. Jul 23 03:30:55 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a 1G" returned: 0 in 0.575s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f6c9582-64cb-4123-8857-b51db37d0abc -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d0477a46-c372-42a7-9c68-7efe1dc9815a tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-615dc477-c751-4580-9c8c-0df25abff376-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:55 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f6c9582-64cb-4123-8857-b51db37d0abc -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a Jul 23 03:30:55 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:55 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f6c9582-64cb-4123-8857-b51db37d0abc -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a" returned: 0 in 0.333s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:55 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a is being set with open permissions: ugo+rw Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:55 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a Jul 23 03:30:55 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-2d43e84e-9695-4823-a66a-dbd7f34ef592-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-2d43e84e-9695-4823-a66a-dbd7f34ef592-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:56 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8030ea2-9ce5-42f0-b507-092db4cf912c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info Jul 23 03:30:56 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 Jul 23 03:30:56 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info" returned: 0 in 0.332s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info is being set with open permissions: ugo+rw Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info Jul 23 03:30:56 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592" returned: 0 in 0.474s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592 Jul 23 03:30:56 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.info" returned: 0 in 0.328s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-77446d10-f579-4d11-9699-a92e187610fb tempest-CinderUnicodeTest-184112596 None] Create snapshot completed successfully Jul 23 03:30:57 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2d43e84e-9695-4823-a66a-dbd7f34ef592" returned: 0 in 0.349s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-quobyte-2d43e84e-9695-4823-a66a-dbd7f34ef592" released by "delete_volume" :: held 0.927s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Created reservations ['55994125-558e-406a-892f-5445c81d4fdd', '46cd0f17-3dd8-4d48-9b7e-cac2d15c9f5f', 'fc00fbf8-88af-4a8b-bb9b-f2e97033cb0e', '8802b199-0e58-4dad-b8bb-90c50f5b3581'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:57 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:57 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Flow 'volume_create_manager' (72ef0251-9aec-4bbb-bbb1-b0246f02e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46433b1f-e1af-443b-8b6c-7a2686424b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-37cad24e-10e7-457e-a216-afc2ea03ed7a-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46433b1f-e1af-443b-8b6c-7a2686424b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2008194437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a972fb2-9899-47b4-8f19-51b7acfa2dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b3ee38c934216bcd2ba7c39c1db98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='f67f4b8110004662b3c98d1f1adadf30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2229819a-f3f8-412d-89e2-e416a889b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2229819a-f3f8-412d-89e2-e416a889b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43229270-52ea-4bce-aede-1f7501af6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43229270-52ea-4bce-aede-1f7501af6103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a972fb2-9899-47b4-8f19-51b7acfa2dde', 'volume_name': 'volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4acbb3-1c81-44cb-a599-3a3c20a99d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4acbb3-1c81-44cb-a599-3a3c20a99d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbed76cd-aa0c-435d-9e31-9a82268b3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:57 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Volume 2a972fb2-9899-47b4-8f19-51b7acfa2dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde', 'volume_size': 1} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2008194437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a972fb2-9899-47b4-8f19-51b7acfa2dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b3ee38c934216bcd2ba7c39c1db98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='f67f4b8110004662b3c98d1f1adadf30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Creating volume 2a972fb2-9899-47b4-8f19-51b7acfa2dde {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:57 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-37cad24e-10e7-457e-a216-afc2ea03ed7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-quobyte-37cad24e-10e7-457e-a216-afc2ea03ed7a" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:57 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde 1073741824 Jul 23 03:30:57 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-37cad24e-10e7-457e-a216-afc2ea03ed7a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Deleting offline snapshot 37cad24e-10e7-457e-a216-afc2ea03ed7a of volume 7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:57 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] snapshot_file for this snap is: volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Deleted volume successfully. Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[92492171-dccd-4d71-b499-3cbf6473940b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-79597e59-a576-4453-bc9f-83211a1be3c7 tempest-VolumesSnapshotTestJSON-800927785 None] Lock "cinder-2d43e84e-9695-4823-a66a-dbd7f34ef592-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e707dda8-9fa7-4de5-8dbe-dc05e38b4f28 req-b2bcc3e1-313c-4b7c-970a-f567665bc1c8 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Terminate volume connection completed successfully. Jul 23 03:30:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e707dda8-9fa7-4de5-8dbe-dc05e38b4f28 req-b2bcc3e1-313c-4b7c-970a-f567665bc1c8 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Deleting attachment 4f8e6a96-b136-4dfc-9317-0e4053296833. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:30:57 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a Jul 23 03:30:57 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f6c9582-64cb-4123-8857-b51db37d0abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7ac233-d051-4abf-b80a-77fcb100d9b1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde 1073741824" returned: 0 in 0.655s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde Jul 23 03:30:58 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc Jul 23 03:30:58 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "cinder-2ef3c580-f6f8-4ebe-aacf-bea6f9024264-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "cinder-2ef3c580-f6f8-4ebe-aacf-bea6f9024264-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:58 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde" returned: 0 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "cinder-quobyte-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbed76cd-aa0c-435d-9e31-9a82268b3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be82d00-0118-4892-8162-f78eb5a674e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "cinder-quobyte-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:58 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc" returned: 0 in 0.544s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abaaeb3-2293-4bbb-91ad-70847d4e228f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Volume volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde (2a972fb2-9899-47b4-8f19-51b7acfa2dde): created successfully Jul 23 03:30:58 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a Jul 23 03:30:58 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be82d00-0118-4892-8162-f78eb5a674e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Flow 'volume_create_manager' (72ef0251-9aec-4bbb-bbb1-b0246f02e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:58 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b9b55afd-df35-46e7-9a25-e40e4578fe2d tempest-VolumesNegativeTest-890026868 None] Created volume successfully. Jul 23 03:30:58 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 Jul 23 03:30:58 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:59 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:59 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a Jul 23 03:30:59 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:59 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:59 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264 Jul 23 03:30:59 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:59 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc.37cad24e-10e7-457e-a216-afc2ea03ed7a" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-37cad24e-10e7-457e-a216-afc2ea03ed7a" released by "_delete_snapshot" :: held 1.911s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" released by "delete_snapshot" :: held 1.941s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:59 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" returned: 0 in 0.332s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "cinder-quobyte-2ef3c580-f6f8-4ebe-aacf-bea6f9024264" released by "delete_volume" :: held 0.889s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Created reservations ['09b0fd31-326d-40a9-b06c-eb078cc860f6', '56e94060-74ae-4b2d-a5b1-c05e01e587da', '216807d2-a890-4463-81b6-31fd3ae25492', 'd895d965-ccb0-4f81-8b07-ddc8b254e6d0'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Created reservations ['a91743ad-dde1-42f9-ac5a-96ce99caf9b0', '78ef62e2-4b72-4276-bc4d-317276f03a8c', '82be3ec7-7195-44f3-af4f-1f63e0f29950', 'c5eb0532-5afe-4f84-86ea-9b47cad6ab4f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Delete snapshot completed successfully. Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b47af1fd-0362-4e0f-95eb-6a87eb4e56d6 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-37cad24e-10e7-457e-a216-afc2ea03ed7a-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:59 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:30:59 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:00 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Deleted volume successfully. Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e8d16b16-e20a-495a-8dba-a2385bf6af24 tempest-TestServerVolumeAttachScenarioOldVersion-1447266749 None] Lock "cinder-2ef3c580-f6f8-4ebe-aacf-bea6f9024264-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-7f6c9582-64cb-4123-8857-b51db37d0abc-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-7f6c9582-64cb-4123-8857-b51db37d0abc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce02030-977f-4954-bfbe-ed5d8a4f2d42]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:01 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc Jul 23 03:31:01 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:01 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc" returned: 0 in 0.599s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:01 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc Jul 23 03:31:01 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:02 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-7f6c9582-64cb-4123-8857-b51db37d0abc" returned: 0 in 0.629s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-7f6c9582-64cb-4123-8857-b51db37d0abc" released by "delete_volume" :: held 1.332s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Created reservations ['55f8d625-7803-4048-8580-14426cf038b3', '58ece6a9-828e-4ba1-8742-deeb29015f33', '31d0eed6-e50e-402b-8ad3-1e1e8d57bc5a', 'fbb53d32-2574-4dac-8db8-8c55077d0386'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:02 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:31:02 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:02 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.581s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Deleted volume successfully. Jul 23 03:31:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-29fa561d-be04-4006-9483-5fc9a0b8f328 tempest-CinderUnicodeTest-184112596 None] Lock "cinder-7f6c9582-64cb-4123-8857-b51db37d0abc-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-2dea54d1-5f6e-4280-94ae-108efa2cfdf1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "cinder-2dea54d1-5f6e-4280-94ae-108efa2cfdf1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Acquiring lock "cinder-quobyte-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f92f2a0-d0ae-401a-825d-cc3ef1e8a979]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:03 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 Jul 23 03:31:03 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:03 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" returned: 0 in 0.605s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:03 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1 Jul 23 03:31:03 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:04 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "cinder-quobyte-2dea54d1-5f6e-4280-94ae-108efa2cfdf1" released by "delete_volume" :: held 1.004s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Created reservations ['5f71ff64-dc42-437e-893a-d2fdc100b14f', '782da0e8-fcf3-4957-b01e-829360cecc39', '512483b7-a6b1-45af-a1f8-23b2911e97c2', '347db637-cde4-47db-afab-ad1cef3aa409'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:04 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:31:04 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:04 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.298s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Deleted volume successfully. Jul 23 03:31:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b040846b-5b5f-472b-8e12-7f9557867eea tempest-CinderUnicodeTest-184112596 None] Lock "cinder-2dea54d1-5f6e-4280-94ae-108efa2cfdf1-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=100,cinder:DELETE=10,cinder:INSERT=25,cinder:SELECT=66 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=62,cinder:SELECT=51,cinder:INSERT=13,cinder:DELETE=3 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Acquiring lock "cinder-2a972fb2-9899-47b4-8f19-51b7acfa2dde-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "cinder-2a972fb2-9899-47b4-8f19-51b7acfa2dde-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Acquiring lock "cinder-quobyte-2a972fb2-9899-47b4-8f19-51b7acfa2dde" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "cinder-quobyte-2a972fb2-9899-47b4-8f19-51b7acfa2dde" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc05dcef-ee33-46de-8000-7036bc1ed262]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:35 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:31:35 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:35 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde Jul 23 03:31:35 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:36 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:31:36 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:36 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde Jul 23 03:31:36 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:36 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2a972fb2-9899-47b4-8f19-51b7acfa2dde" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "cinder-quobyte-2a972fb2-9899-47b4-8f19-51b7acfa2dde" released by "delete_volume" :: held 0.891s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Created reservations ['80031fa7-a86c-4149-8ed3-3a9de1a37a56', '5553d48a-60cb-4011-bf1b-b86b9c0922ac', 'b6a067f1-28e6-4a26-bfe5-cfa9637e6be4', '5163f0df-64e2-4f19-8779-7c1f1078eb44'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:36 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:31:36 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.332s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Deleted volume successfully. Jul 23 03:31:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2545c0be-e9e2-46e4-87bd-78690c66bd57 tempest-VolumesNegativeTest-890026868 None] Lock "cinder-2a972fb2-9899-47b4-8f19-51b7acfa2dde-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Flow 'volume_create_manager' (fa6cde44-bba1-4f9e-9dd9-44af0d2294b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3365a26-335e-421f-b049-54e894fb2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3365a26-335e-421f-b049-54e894fb2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2126507560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4049a5e5-f130-4e7e-89b5-4022d27d9d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6403f8334af0aa07af86e17972cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:44Z,use_quota=True,user_id='9bcd13466cef465ab1d08ffb84d13fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1486555-16f8-4de5-be17-e453c6b5bedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1486555-16f8-4de5-be17-e453c6b5bedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee7dbf-1ac1-4134-9511-aa910d881527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee7dbf-1ac1-4134-9511-aa910d881527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4049a5e5-f130-4e7e-89b5-4022d27d9d1f', 'volume_name': 'volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f', 'volume_size': 2}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015700f2-4cfc-448a-b485-dd34f0c89aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015700f2-4cfc-448a-b485-dd34f0c89aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ff9a35-b55d-49ed-9d82-b0a8b2abb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Volume 4049a5e5-f130-4e7e-89b5-4022d27d9d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f', 'volume_size': 2} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2126507560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4049a5e5-f130-4e7e-89b5-4022d27d9d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96c6403f8334af0aa07af86e17972cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:44Z,use_quota=True,user_id='9bcd13466cef465ab1d08ffb84d13fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Creating volume 4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:43 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:31:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f 2147483648 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:43 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f 2147483648 Jul 23 03:31:43 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:44 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f 2147483648" returned: 0 in 0.737s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:44 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f Jul 23 03:31:44 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:44 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ff9a35-b55d-49ed-9d82-b0a8b2abb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f', 'volume_size': 2}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b61b4-fc87-44a3-a3a4-50ae63214be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:44 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Volume volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f (4049a5e5-f130-4e7e-89b5-4022d27d9d1f): created successfully Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b61b4-fc87-44a3-a3a4-50ae63214be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Flow 'volume_create_manager' (fa6cde44-bba1-4f9e-9dd9-44af0d2294b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d9d372e4-45e4-4ea0-943c-c25e3fbd34f3 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Created volume successfully. Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Creating offline snapshot 9ac4398a-d689-40b5-a90c-b77844758719 of volume 4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5bfc71-161d-43da-9cde-cdad557bdc62]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f Jul 23 03:31:46 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" returned: 0 in 0.427s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 2G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 2G Jul 23 03:31:46 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:47 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 2G" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:47 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 Jul 23 03:31:47 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:47 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719" returned: 0 in 0.614s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:47 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 is being set with open permissions: ugo+rw Jul 23 03:31:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:47 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 Jul 23 03:31:47 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719" returned: 0 in 0.385s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:48 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info Jul 23 03:31:48 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info is being set with open permissions: ugo+rw Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:48 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info Jul 23 03:31:48 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.info" returned: 0 in 0.353s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-de11a602-1dd4-4d12-ac96-7580ac04bd71 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Create snapshot completed successfully Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "cinder-9ac4398a-d689-40b5-a90c-b77844758719-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-9ac4398a-d689-40b5-a90c-b77844758719-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "cinder-quobyte-9ac4398a-d689-40b5-a90c-b77844758719" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-9ac4398a-d689-40b5-a90c-b77844758719" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Deleting offline snapshot 9ac4398a-d689-40b5-a90c-b77844758719 of volume 4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] snapshot_file for this snap is: volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d898b8e-7bea-47ee-937d-893f7b2b1875]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:49 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 Jul 23 03:31:49 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:50 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719" returned: 0 in 0.540s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f51e83a-55a1-4ca8-87e3-69d59b868edd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:50 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f Jul 23 03:31:50 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:50 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" returned: 0 in 0.634s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:50 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 Jul 23 03:31:50 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719" returned: 0 in 0.574s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719 Jul 23 03:31:51 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f.9ac4398a-d689-40b5-a90c-b77844758719" returned: 0 in 0.443s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-9ac4398a-d689-40b5-a90c-b77844758719" released by "_delete_snapshot" :: held 2.373s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" released by "delete_snapshot" :: held 2.417s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:51 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Created reservations ['10799884-7950-4320-b0d2-e58b2de104d9', 'bd588c13-496b-4435-a722-fff76941b516', '28bac0e2-66e9-4d21-a644-b113c0e1cd7f', '0f3d02fd-da66-41e8-8e98-28923496732c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Delete snapshot completed successfully. Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a3dfea33-d945-4845-a1f6-3db33e33bcd9 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-9ac4398a-d689-40b5-a90c-b77844758719-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "cinder-4049a5e5-f130-4e7e-89b5-4022d27d9d1f-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-4049a5e5-f130-4e7e-89b5-4022d27d9d1f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a79b0d-6cbf-4aee-874b-9a0d6bc9767d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:53 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f Jul 23 03:31:53 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:53 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" returned: 0 in 0.535s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:53 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f Jul 23 03:31:53 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:53 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-quobyte-4049a5e5-f130-4e7e-89b5-4022d27d9d1f" released by "delete_volume" :: held 0.993s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:53 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Created reservations ['40ca66ad-db25-4d04-aea1-dc921e5bcdec', '9ba02c8c-bda5-4f71-9d28-d9d92ef9a49a', '26dc8924-2804-4e4d-9476-a046f6650bd9', '0f95e2f2-3483-40d3-a843-338876340a30'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:54 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:31:54 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:54 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Deleted volume successfully. Jul 23 03:31:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c069c671-4078-46a3-a77d-2d8c21651032 tempest-VolumesSnapshotNegativeTestJSON-154257037 None] Lock "cinder-4049a5e5-f130-4e7e-89b5-4022d27d9d1f-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Flow 'volume_create_manager' (79ffa5b7-b199-47d4-af23-e26833bb7b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10e3588-a2da-4ee1-96d1-af0dc80e80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10e3588-a2da-4ee1-96d1-af0dc80e80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-739614071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776470df-7dc9-44fe-b02f-5c698cc22e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a19ddabbc40949fc385a1bf203b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:56Z,use_quota=True,user_id='9c193557f7e54d7a8683e23d009f643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128c6cf5-84ac-428a-9a55-3f060c45d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128c6cf5-84ac-428a-9a55-3f060c45d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba86def-ca78-40ef-9580-e4b8aedcfd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba86def-ca78-40ef-9580-e4b8aedcfd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776470df-7dc9-44fe-b02f-5c698cc22e61', 'volume_name': 'volume-776470df-7dc9-44fe-b02f-5c698cc22e61', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8de7cc-49a0-4fc0-b14b-5e080dd95eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8de7cc-49a0-4fc0-b14b-5e080dd95eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063b8c97-fe1e-41d3-8343-1c76c1b2433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Volume 776470df-7dc9-44fe-b02f-5c698cc22e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776470df-7dc9-44fe-b02f-5c698cc22e61', 'volume_size': 1} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-739614071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776470df-7dc9-44fe-b02f-5c698cc22e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a19ddabbc40949fc385a1bf203b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:56Z,use_quota=True,user_id='9c193557f7e54d7a8683e23d009f643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Creating volume 776470df-7dc9-44fe-b02f-5c698cc22e61 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:56 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:31:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:56 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 1073741824 Jul 23 03:31:56 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 1073741824" returned: 0 in 0.820s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:57 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 Jul 23 03:31:57 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61" returned: 0 in 0.486s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063b8c97-fe1e-41d3-8343-1c76c1b2433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776470df-7dc9-44fe-b02f-5c698cc22e61', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89b12b6-7066-410f-861e-bd5772722757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:57 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Volume volume-776470df-7dc9-44fe-b02f-5c698cc22e61 (776470df-7dc9-44fe-b02f-5c698cc22e61): created successfully Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89b12b6-7066-410f-861e-bd5772722757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Flow 'volume_create_manager' (79ffa5b7-b199-47d4-af23-e26833bb7b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f9401a7d-18f4-42c0-ac77-86f465875f70 tempest-TestMinimumBasicScenario-1952917125 None] Created volume successfully. Jul 23 03:32:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-8152b7f1-bdb2-4b2b-b16f-c6b44eb58e82 req-d8fd4834-34e1-4ee2-b670-110747f91e16 tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-8152b7f1-bdb2-4b2b-b16f-c6b44eb58e82 req-d8fd4834-34e1-4ee2-b670-110747f91e16 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-8152b7f1-bdb2-4b2b-b16f-c6b44eb58e82 req-d8fd4834-34e1-4ee2-b670-110747f91e16 tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-8152b7f1-bdb2-4b2b-b16f-c6b44eb58e82 req-d8fd4834-34e1-4ee2-b670-110747f91e16 tempest-TestMinimumBasicScenario-1952917125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-776470df-7dc9-44fe-b02f-5c698cc22e61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a9da650-932b-4331-8d3a-0e2f821cf31b', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:32:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-8152b7f1-bdb2-4b2b-b16f-c6b44eb58e82 req-d8fd4834-34e1-4ee2-b670-110747f91e16 tempest-TestMinimumBasicScenario-1952917125 None] attachment_update completed successfully. Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Flow 'volume_create_manager' (0cefc2bf-7fc8-48f3-a2dd-afbb46e3cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d83a76-852e-4dd7-8c7e-04ce91df0ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d83a76-852e-4dd7-8c7e-04ce91df0ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420535883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a237b4-c76a-4e87-9e00-f2065e1076b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591a825a206a4ea8b9d734e60bb75165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:03Z,use_quota=True,user_id='fab45caaf2ab472daaecdfa560a55c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004f7415-b547-4862-8474-394875454912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004f7415-b547-4862-8474-394875454912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ebd0bd-a060-4a48-bc03-7e8e03e87161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ebd0bd-a060-4a48-bc03-7e8e03e87161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a237b4-c76a-4e87-9e00-f2065e1076b3', 'volume_name': 'volume-98a237b4-c76a-4e87-9e00-f2065e1076b3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fee3482-0da1-47c0-97dc-b334beaa3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fee3482-0da1-47c0-97dc-b334beaa3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841357d7-a4ba-4c4d-8a76-87f5a439f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Volume 98a237b4-c76a-4e87-9e00-f2065e1076b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a237b4-c76a-4e87-9e00-f2065e1076b3', 'volume_size': 1} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420535883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a237b4-c76a-4e87-9e00-f2065e1076b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591a825a206a4ea8b9d734e60bb75165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:03Z,use_quota=True,user_id='fab45caaf2ab472daaecdfa560a55c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Creating volume 98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:03 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:32:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:03 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 1073741824 Jul 23 03:32:03 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:04 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 1073741824" returned: 0 in 0.620s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:04 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:32:04 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:04 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841357d7-a4ba-4c4d-8a76-87f5a439f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a237b4-c76a-4e87-9e00-f2065e1076b3', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f34ff19-61fc-42bc-b3b5-c883b2022c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Volume volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 (98a237b4-c76a-4e87-9e00-f2065e1076b3): created successfully Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f34ff19-61fc-42bc-b3b5-c883b2022c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Flow 'volume_create_manager' (0cefc2bf-7fc8-48f3-a2dd-afbb46e3cbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae1c4ffd-56d8-4273-8a10-08e57e3a34c5 tempest-TestStampPattern-382813522 None] Created volume successfully. Jul 23 03:32:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=30,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=4 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (4982cdec-9af3-451a-a7d9-bc45e322a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb5807b-27bf-4a30-9165-499f62baa016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb5807b-27bf-4a30-9165-499f62baa016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156868372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61a27c6-3562-47dd-85d9-3234a803b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:31Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e6eb303-ca50-4285-bd1b-7c6fda8e3333),volume_type_id=8e6eb303-ca50-4285-bd1b-7c6fda8e3333)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31429b76-2e99-418a-9ded-7946a5facd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31429b76-2e99-418a-9ded-7946a5facd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff119a2-aa34-40c0-b55e-7f304e9183a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff119a2-aa34-40c0-b55e-7f304e9183a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61a27c6-3562-47dd-85d9-3234a803b107', 'volume_name': 'volume-d61a27c6-3562-47dd-85d9-3234a803b107', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a7e02e-129a-46fe-8dc8-c5ce3c3dbd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a7e02e-129a-46fe-8dc8-c5ce3c3dbd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a299c8e5-f631-4e0f-9da2-9cca030a758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Volume d61a27c6-3562-47dd-85d9-3234a803b107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61a27c6-3562-47dd-85d9-3234a803b107', 'volume_size': 1} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156868372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61a27c6-3562-47dd-85d9-3234a803b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:31Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e6eb303-ca50-4285-bd1b-7c6fda8e3333),volume_type_id=8e6eb303-ca50-4285-bd1b-7c6fda8e3333)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Creating volume d61a27c6-3562-47dd-85d9-3234a803b107 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:31 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:31 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 1073741824 Jul 23 03:32:31 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:31 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 1073741824" returned: 0 in 0.610s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (55fc1f42-3517-428f-ba5b-5abd763b53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9032101-8a49-4c3a-8179-8ca7a61c53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9032101-8a49-4c3a-8179-8ca7a61c53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2064710626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8e5d88-e55d-4196-9b2f-b27eff9989b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:32Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82381f71-ba08-4c6a-ae00-bdc1c39b82ad),volume_type_id=82381f71-ba08-4c6a-ae00-bdc1c39b82ad)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd060db0-22af-4438-ba5b-226c53608911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd060db0-22af-4438-ba5b-226c53608911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90fa8ee-1dd1-4cfd-9ba1-5549c23aeacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90fa8ee-1dd1-4cfd-9ba1-5549c23aeacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8e5d88-e55d-4196-9b2f-b27eff9989b6', 'volume_name': 'volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec25504c-c564-4126-b33c-51aecc0e6093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec25504c-c564-4126-b33c-51aecc0e6093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d8b420-a8f6-4941-8d9e-9d2917cd4cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Volume fe8e5d88-e55d-4196-9b2f-b27eff9989b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6', 'volume_size': 1} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:32 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 Jul 23 03:32:32 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:32 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107" returned: 0 in 0.369s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2064710626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8e5d88-e55d-4196-9b2f-b27eff9989b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:32Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82381f71-ba08-4c6a-ae00-bdc1c39b82ad),volume_type_id=82381f71-ba08-4c6a-ae00-bdc1c39b82ad)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Creating volume fe8e5d88-e55d-4196-9b2f-b27eff9989b6 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:32 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a299c8e5-f631-4e0f-9da2-9cca030a758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61a27c6-3562-47dd-85d9-3234a803b107', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77326b63-2261-4f25-bb6c-ec84186f7974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 1073741824 Jul 23 03:32:32 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Volume volume-d61a27c6-3562-47dd-85d9-3234a803b107 (d61a27c6-3562-47dd-85d9-3234a803b107): created successfully Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77326b63-2261-4f25-bb6c-ec84186f7974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (4982cdec-9af3-451a-a7d9-bc45e322a704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5d4bdbac-f609-48e4-823b-fdfee9379bda tempest-TestInstancesWithCinderVolumes-945876302 None] Created volume successfully. Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (c0d67f19-09a1-473f-b526-1ea0ae679167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad12172-fa9b-45ba-b41b-68ccd9dc6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad12172-fa9b-45ba-b41b-68ccd9dc6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-497428573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17a1633-d507-4a82-b39b-12789d0d1304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:33Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7aa98ac-b675-4310-b5f9-a8ee2bba8ac4),volume_type_id=a7aa98ac-b675-4310-b5f9-a8ee2bba8ac4)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f224c-2de2-442f-86d7-a34df7a8bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f224c-2de2-442f-86d7-a34df7a8bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b7a3b0-7d92-41b2-bbe8-962a6b4acb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:32 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:32:33 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 1073741824" returned: 0 in 0.659s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b7a3b0-7d92-41b2-bbe8-962a6b4acb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b17a1633-d507-4a82-b39b-12789d0d1304', 'volume_name': 'volume-b17a1633-d507-4a82-b39b-12789d0d1304', 'volume_size': 1, 'image_id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1468361197', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c56cb99320245d2b9d2a1bbefc22805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a002fdae-aa5e-490b-ac95-f3664cdaa546/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcebb2d5-5d80-4e1a-aee0-84ad41e36a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcebb2d5-5d80-4e1a-aee0-84ad41e36a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd8ea1-6f7a-478f-a5c5-ad9d4413c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Volume b17a1633-d507-4a82-b39b-12789d0d1304: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b17a1633-d507-4a82-b39b-12789d0d1304', 'volume_size': 1, 'image_id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1468361197', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c56cb99320245d2b9d2a1bbefc22805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a002fdae-aa5e-490b-ac95-f3664cdaa546/file', 'properties': {}}, 'image_service': } Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Trying to clone b17a1633-d507-4a82-b39b-12789d0d1304 from image a002fdae-aa5e-490b-ac95-f3664cdaa546 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:33 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 Jul 23 03:32:33 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:33 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d8b420-a8f6-4941-8d9e-9d2917cd4cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93277832-04dc-4c49-bcf1-33095ab83c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Volume volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 (fe8e5d88-e55d-4196-9b2f-b27eff9989b6): created successfully Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93277832-04dc-4c49-bcf1-33095ab83c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (55fc1f42-3517-428f-ba5b-5abd763b53ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9617f5b2-b14b-4c11-82ec-7919c6188f9a tempest-TestInstancesWithCinderVolumes-945876302 None] Created volume successfully. Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:35 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:32:35 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:36 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.289s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD, size 20.69 MB, duration 3.21 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:32:36 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Image download 20.69 MB at 6.44 MB/s Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52b53b-754e-4d5a-acd2-c07d82d05d7e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:36 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD Jul 23 03:32:36 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:36 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Temporary image a002fdae-aa5e-490b-ac95-f3664cdaa546 is fetched for user 83675a53091d43d1b8896ef54b2d8cae. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c4fb8c-04ef-42ec-9517-776913c6d801]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:37 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD Jul 23 03:32:37 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:37 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-497428573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17a1633-d507-4a82-b39b-12789d0d1304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56cb99320245d2b9d2a1bbefc22805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:33Z,use_quota=True,user_id='83675a53091d43d1b8896ef54b2d8cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7aa98ac-b675-4310-b5f9-a8ee2bba8ac4),volume_type_id=a7aa98ac-b675-4310-b5f9-a8ee2bba8ac4)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Creating volume b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:37 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:37 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1073741824 Jul 23 03:32:37 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:37 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1073741824" returned: 0 in 0.495s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:37 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 Jul 23 03:32:37 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:38 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304" returned: 0 in 0.270s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Attempting download of a002fdae-aa5e-490b-ac95-f3664cdaa546 ((None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}])) to volume b17a1633-d507-4a82-b39b-12789d0d1304. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe0b57b-ae81-44b9-8155-671730e4b772]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:38 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc Jul 23 03:32:38 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:38 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:38 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc Jul 23 03:32:38 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:38 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc" returned: 1 in 0.353s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a002fdae-aa5e-490b-ac95-f3664cdaa546_z7_sdebc' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abc15ce-ffc2-4a28-a3bb-bb32adae1ce6]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:39 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD Jul 23 03:32:39 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:39 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:39 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] a002fdae-aa5e-490b-ac95-f3664cdaa546 was qcow2, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:32:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:39 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 Jul 23 03:32:39 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:41 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304" returned: 0 in 1.998s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a002fdae-aa5e-490b-ac95-f3664cdaa546_hbbxykumdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:32:41 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Converted 112.00 MB image at 56.02 MB/s Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:41 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1G Jul 23 03:32:41 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:41 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 1G" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Downloaded image a002fdae-aa5e-490b-ac95-f3664cdaa546 ((None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}])) to volume b17a1633-d507-4a82-b39b-12789d0d1304 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Temporary image a002fdae-aa5e-490b-ac95-f3664cdaa546 for user 83675a53091d43d1b8896ef54b2d8cae is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Marking volume b17a1633-d507-4a82-b39b-12789d0d1304 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Copying metadata from image a002fdae-aa5e-490b-ac95-f3664cdaa546 to b17a1633-d507-4a82-b39b-12789d0d1304. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Creating volume glance metadata for volume b17a1633-d507-4a82-b39b-12789d0d1304 backed by image a002fdae-aa5e-490b-ac95-f3664cdaa546 with: {'image_id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'image_name': 'tempest-scenario-img--1468361197', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd8ea1-6f7a-478f-a5c5-ad9d4413c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17a1633-d507-4a82-b39b-12789d0d1304', 'volume_size': 1, 'image_id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a002fdae-aa5e-490b-ac95-f3664cdaa546', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1468361197', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c56cb99320245d2b9d2a1bbefc22805', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a002fdae-aa5e-490b-ac95-f3664cdaa546', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a002fdae-aa5e-490b-ac95-f3664cdaa546/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e725e903-9e9f-4185-93bf-c3c32ddaecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Volume volume-b17a1633-d507-4a82-b39b-12789d0d1304 (b17a1633-d507-4a82-b39b-12789d0d1304): created successfully Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e725e903-9e9f-4185-93bf-c3c32ddaecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Flow 'volume_create_manager' (c0d67f19-09a1-473f-b526-1ea0ae679167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5917b348-3c66-4332-9d7f-42823db2551f tempest-TestInstancesWithCinderVolumes-945876302 None] Created volume successfully. Jul 23 03:32:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ae625035-60c2-4599-a19a-a4f384835826 req-575167c1-69c6-4c0e-a3f4-aa60832b1061 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ae625035-60c2-4599-a19a-a4f384835826 req-575167c1-69c6-4c0e-a3f4-aa60832b1061 tempest-TestStampPattern-382813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-ae625035-60c2-4599-a19a-a4f384835826 req-575167c1-69c6-4c0e-a3f4-aa60832b1061 tempest-TestStampPattern-382813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-ae625035-60c2-4599-a19a-a4f384835826 req-575167c1-69c6-4c0e-a3f4-aa60832b1061 tempest-TestStampPattern-382813522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-98a237b4-c76a-4e87-9e00-f2065e1076b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4de75991-d103-423b-8d73-6b07c3cacc03', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:32:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-ae625035-60c2-4599-a19a-a4f384835826 req-575167c1-69c6-4c0e-a3f4-aa60832b1061 tempest-TestStampPattern-382813522 None] attachment_update completed successfully. Jul 23 03:32:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-51c57519-4d34-4076-9673-fd63cd315d00 req-ad8c6a8a-2e7e-412a-897a-dc03065ee87e tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-51c57519-4d34-4076-9673-fd63cd315d00 req-ad8c6a8a-2e7e-412a-897a-dc03065ee87e tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-51c57519-4d34-4076-9673-fd63cd315d00 req-ad8c6a8a-2e7e-412a-897a-dc03065ee87e tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-51c57519-4d34-4076-9673-fd63cd315d00 req-ad8c6a8a-2e7e-412a-897a-dc03065ee87e tempest-TestInstancesWithCinderVolumes-945876302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-b17a1633-d507-4a82-b39b-12789d0d1304', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54c990c6-a027-4b33-a3a1-56c2c08e79cd', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:32:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-51c57519-4d34-4076-9673-fd63cd315d00 req-ad8c6a8a-2e7e-412a-897a-dc03065ee87e tempest-TestInstancesWithCinderVolumes-945876302 None] attachment_update completed successfully. Jul 23 03:32:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-3eb6a95a-ad12-4854-b95f-ab3105ecbdc2 req-021a84ff-6f60-4bca-9c60-4735920a245f tempest-TestStampPattern-382813522 None] Terminate volume connection completed successfully. Jul 23 03:32:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-3eb6a95a-ad12-4854-b95f-ab3105ecbdc2 req-021a84ff-6f60-4bca-9c60-4735920a245f tempest-TestStampPattern-382813522 None] Deleting attachment 4de75991-d103-423b-8d73-6b07c3cacc03. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Creating offline snapshot a42e05ac-26ee-4f52-bb94-9dea29bc63a8 of volume 98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7455554-e2b4-421b-bfa6-afde50aae988]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:51 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:32:51 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:51 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.616s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 1G Jul 23 03:32:52 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:52 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 1G" returned: 0 in 0.878s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:32:52 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:53 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:53 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 is being set with open permissions: ugo+rw Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:53 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:32:53 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-b57db253-cfaf-411e-9b3c-77bd73511783 req-8d24019a-b601-4b99-9682-872dd51c1568 tempest-TestMinimumBasicScenario-1952917125 None] Terminate volume connection completed successfully. Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-b57db253-cfaf-411e-9b3c-77bd73511783 req-8d24019a-b601-4b99-9682-872dd51c1568 tempest-TestMinimumBasicScenario-1952917125 None] Deleting attachment 9a9da650-932b-4331-8d3a-0e2f821cf31b. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:32:53 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:53 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info Jul 23 03:32:53 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:53 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info" returned: 0 in 0.314s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:53 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info is being set with open permissions: ugo+rw Jul 23 03:32:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info Jul 23 03:32:54 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "cinder-776470df-7dc9-44fe-b02f-5c698cc22e61-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "cinder-776470df-7dc9-44fe-b02f-5c698cc22e61-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "cinder-quobyte-776470df-7dc9-44fe-b02f-5c698cc22e61" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "cinder-quobyte-776470df-7dc9-44fe-b02f-5c698cc22e61" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde692d4-2386-4f96-971b-562a60231d20]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.info" returned: 0 in 0.492s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.214s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:54 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 Jul 23 03:32:54 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-603b205a-65ec-4410-87e1-497f85f9bdf1 tempest-TestStampPattern-382813522 None] Create snapshot completed successfully Jul 23 03:32:54 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61" returned: 0 in 0.503s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61 Jul 23 03:32:54 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-776470df-7dc9-44fe-b02f-5c698cc22e61" returned: 0 in 0.309s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "cinder-quobyte-776470df-7dc9-44fe-b02f-5c698cc22e61" released by "delete_volume" :: held 0.869s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Created reservations ['b1a2bc6c-1566-4cc0-96cd-43809a4f351b', '3af06bf5-14f3-4302-8c6e-feb3cf52a7bc', '8ccf55cb-ca5f-4af7-a61f-1377e74ca9ff', 'bdb86f9f-3c72-4c04-8ab4-72195b461116'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:55 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:32:55 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.325s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Deleted volume successfully. Jul 23 03:32:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ab6790aa-d933-4d25-b305-2a28b8e79d8b tempest-TestMinimumBasicScenario-1952917125 None] Lock "cinder-776470df-7dc9-44fe-b02f-5c698cc22e61-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=22,cinder:INSERT=12,cinder:SELECT=32,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=38,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=5 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:06 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Flow 'volume_create_manager' (ba898974-9061-426a-ab84-d4b65afd890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383ed206-67cb-4700-a4ea-1c87f0e0fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383ed206-67cb-4700-a4ea-1c87f0e0fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1143333995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e592ec70-be1f-4772-a12f-13ac89b8bc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591a825a206a4ea8b9d734e60bb75165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a42e05ac-26ee-4f52-bb94-9dea29bc63a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:07Z,use_quota=True,user_id='fab45caaf2ab472daaecdfa560a55c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d5dac9-62b4-4dd5-9224-219a264970a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d5dac9-62b4-4dd5-9224-219a264970a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824754d8-0506-44fe-8846-be2b99f64b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824754d8-0506-44fe-8846-be2b99f64b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e592ec70-be1f-4772-a12f-13ac89b8bc93', 'volume_name': 'volume-e592ec70-be1f-4772-a12f-13ac89b8bc93', 'volume_size': 1, 'snapshot_id': 'a42e05ac-26ee-4f52-bb94-9dea29bc63a8'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09386b84-52c3-41ee-afcd-fa16ab3b3499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09386b84-52c3-41ee-afcd-fa16ab3b3499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f445647-ab5c-4e14-b2f0-534d8f49c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Volume e592ec70-be1f-4772-a12f-13ac89b8bc93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e592ec70-be1f-4772-a12f-13ac89b8bc93', 'volume_size': 1, 'snapshot_id': 'a42e05ac-26ee-4f52-bb94-9dea29bc63a8'} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-e592ec70-be1f-4772-a12f-13ac89b8bc93" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-e592ec70-be1f-4772-a12f-13ac89b8bc93" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Creating volume e592ec70-be1f-4772-a12f-13ac89b8bc93 from snapshot a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] snapshot: a42e05ac-26ee-4f52-bb94-9dea29bc63a8, volume: e592ec70-be1f-4772-a12f-13ac89b8bc93, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a51efc-1ea1-4083-bce8-a6e7edc1194f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:07 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:33:07 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:07 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.508s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a237b4-c76a-4e87-9e00-f2065e1076b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d70a8-14f1-44c6-be83-e9e27c3383df]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:07 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:33:07 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:08 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.458s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:08 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:33:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:08 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 Jul 23 03:33:08 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:15 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93" returned: 0 in 6.969s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44d8f61-00ed-49a8-be6b-787e5b055085]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:15 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:33:15 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:15 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.706s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:33:15 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Converted 1024.00 MB image at 146.91 MB/s Jul 23 03:33:15 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 is being set with open permissions: ugo+rw Jul 23 03:33:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:15 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 Jul 23 03:33:15 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:16 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93" returned: 0 in 0.289s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" released by "_copy_volume_from_snapshot" :: held 9.056s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-e592ec70-be1f-4772-a12f-13ac89b8bc93" released by "_create_volume_from_snapshot" :: held 9.109s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.129s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f445647-ab5c-4e14-b2f0-534d8f49c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e592ec70-be1f-4772-a12f-13ac89b8bc93', 'volume_size': 1, 'snapshot_id': 'a42e05ac-26ee-4f52-bb94-9dea29bc63a8'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddca9f3-9b83-453f-992f-7c37b1cc610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Volume volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 (e592ec70-be1f-4772-a12f-13ac89b8bc93): created successfully Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddca9f3-9b83-453f-992f-7c37b1cc610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Flow 'volume_create_manager' (ba898974-9061-426a-ab84-d4b65afd890f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2cbed718-7e39-4e24-8bd0-4eb7eb7a7182 tempest-TestStampPattern-382813522 None] Created volume successfully. Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (b198212d-903c-4e58-a3c5-d524a78ae799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13077a35-0694-493d-915f-2fa5c0ff506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13077a35-0694-493d-915f-2fa5c0ff506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879217744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86a61d-78af-46fd-b8fd-e1b7780fa8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:20Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b759ef-8a91-4a48-93ce-80a555e35761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b759ef-8a91-4a48-93ce-80a555e35761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eecc76c-333d-4eab-b8d9-415e64139e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eecc76c-333d-4eab-b8d9-415e64139e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d86a61d-78af-46fd-b8fd-e1b7780fa8a2', 'volume_name': 'volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe35dbe-bf7e-4b7e-b831-2703328fd6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe35dbe-bf7e-4b7e-b831-2703328fd6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16a7ce8-423d-4494-a0cf-cb104895f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:20 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume 0d86a61d-78af-46fd-b8fd-e1b7780fa8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2', 'volume_size': 1} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879217744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86a61d-78af-46fd-b8fd-e1b7780fa8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:20Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume 0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:20 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:20 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 1073741824 Jul 23 03:33:20 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:21 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 1073741824" returned: 0 in 0.711s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:21 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 Jul 23 03:33:21 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:21 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16a7ce8-423d-4494-a0cf-cb104895f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1de565-8f82-43c0-8f13-79c629955e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:21 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 (0d86a61d-78af-46fd-b8fd-e1b7780fa8a2): created successfully Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1de565-8f82-43c0-8f13-79c629955e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (b198212d-903c-4e58-a3c5-d524a78ae799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:21 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-58d43e37-f85c-4d8a-b885-92f7db0d63bf tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating offline snapshot 1a74481b-c80a-44a0-9c4d-38edb581aa2d of volume 0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:33:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2515f8-5b60-483f-ad29-f14f492ff414]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:22 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 Jul 23 03:33:22 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:23 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" returned: 0 in 0.529s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:23 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d 1G Jul 23 03:33:23 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:24 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d 1G" returned: 0 in 0.934s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:24 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d Jul 23 03:33:24 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-03545340-7afe-4a6f-b08c-80f49cd148f8 req-0b191a6e-d2f1-4440-8d67-c93d00226516 tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:24 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d" returned: 0 in 0.565s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:24 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d is being set with open permissions: ugo+rw Jul 23 03:33:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:24 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d Jul 23 03:33:24 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:25 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d" returned: 0 in 0.317s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:25 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info Jul 23 03:33:25 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:25 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info" returned: 0 in 0.324s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:25 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info is being set with open permissions: ugo+rw Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:25 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info Jul 23 03:33:25 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:25 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.info" returned: 0 in 0.275s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-03545340-7afe-4a6f-b08c-80f49cd148f8 req-0b191a6e-d2f1-4440-8d67-c93d00226516 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.365s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-03545340-7afe-4a6f-b08c-80f49cd148f8 req-0b191a6e-d2f1-4440-8d67-c93d00226516 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d1182892-70c4-4d97-af59-94c76535cd1f tempest-CreateVolumesFromSnapshotTest-1272026954 None] Create snapshot completed successfully Jul 23 03:33:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-03545340-7afe-4a6f-b08c-80f49cd148f8 req-0b191a6e-d2f1-4440-8d67-c93d00226516 tempest-TestInstancesWithCinderVolumes-945876302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-d61a27c6-3562-47dd-85d9-3234a803b107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7004e3ca-33b2-48ef-abf2-90e8914f0ed3', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:33:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-03545340-7afe-4a6f-b08c-80f49cd148f8 req-0b191a6e-d2f1-4440-8d67-c93d00226516 tempest-TestInstancesWithCinderVolumes-945876302 None] attachment_update completed successfully. Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (1ada8080-bbab-472e-b48b-8aad10b564ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12024ccc-01f6-4d0d-b1a8-ea319d06cc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12024ccc-01f6-4d0d-b1a8-ea319d06cc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892334456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1748671-f769-46d2-b049-e07241b9166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:27Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb36b4e-1395-4c65-944e-c2572de78eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb36b4e-1395-4c65-944e-c2572de78eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8fb154-0c51-44c6-9948-937922d387fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8fb154-0c51-44c6-9948-937922d387fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1748671-f769-46d2-b049-e07241b9166f', 'volume_name': 'volume-b1748671-f769-46d2-b049-e07241b9166f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2e117f-85a1-4e60-91a8-d6bf042cfb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2e117f-85a1-4e60-91a8-d6bf042cfb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8979f118-0e50-4e24-a4eb-fa61607e55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume b1748671-f769-46d2-b049-e07241b9166f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1748671-f769-46d2-b049-e07241b9166f', 'volume_size': 1} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892334456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1748671-f769-46d2-b049-e07241b9166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:27Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume b1748671-f769-46d2-b049-e07241b9166f {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:27 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:27 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f 1073741824 Jul 23 03:33:27 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (8c09f903-9211-4c72-a9f8-d348771d1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f425f28-4003-431f-a3a4-b52d544b9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f425f28-4003-431f-a3a4-b52d544b9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163852455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a603e597-116c-4fac-a2b2-59905d4c1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c689118-5df9-4812-8d50-8ffa5afe8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c689118-5df9-4812-8d50-8ffa5afe8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7315257f-112b-4d96-b318-9b2387ce2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7315257f-112b-4d96-b318-9b2387ce2b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a603e597-116c-4fac-a2b2-59905d4c1b0c', 'volume_name': 'volume-a603e597-116c-4fac-a2b2-59905d4c1b0c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6337da-955e-4fc0-a448-97774333e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6337da-955e-4fc0-a448-97774333e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec6f6a-4fbd-4444-a1b5-b06da9a9bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume a603e597-116c-4fac-a2b2-59905d4c1b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a603e597-116c-4fac-a2b2-59905d4c1b0c', 'volume_size': 1} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:28 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f 1073741824" returned: 0 in 0.754s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:28 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f Jul 23 03:33:28 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (22e5679e-7648-4427-af1f-119ea0fc4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f356c7e2-1e7b-4c82-a112-298dfd2c8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f356c7e2-1e7b-4c82-a112-298dfd2c8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509150820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ecf056-dfa0-49e4-bc28-be1b8bea503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a856cd76-d763-4bfa-af4d-5341208d6325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a856cd76-d763-4bfa-af4d-5341208d6325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43be87c4-cf68-4b36-a809-1891258a5c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43be87c4-cf68-4b36-a809-1891258a5c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ecf056-dfa0-49e4-bc28-be1b8bea503e', 'volume_name': 'volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e63b23-08ec-42cb-a41b-fb980df9203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e63b23-08ec-42cb-a41b-fb980df9203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a1f3f7-467b-41f6-a970-1daf6b4fb798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume f0ecf056-dfa0-49e4-bc28-be1b8bea503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e', 'volume_size': 1} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:28 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f" returned: 0 in 0.482s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163852455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a603e597-116c-4fac-a2b2-59905d4c1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume a603e597-116c-4fac-a2b2-59905d4c1b0c {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:28 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:28 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c 1073741824 Jul 23 03:33:28 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8979f118-0e50-4e24-a4eb-fa61607e55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1748671-f769-46d2-b049-e07241b9166f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc76903-7e00-428b-9eaf-af02ac003bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-b1748671-f769-46d2-b049-e07241b9166f (b1748671-f769-46d2-b049-e07241b9166f): created successfully Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc76903-7e00-428b-9eaf-af02ac003bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (1ada8080-bbab-472e-b48b-8aad10b564ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7941cbf4-9ce0-473f-9e34-b07ff195747b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e8213c42-59ac-43b7-a21b-bca071ff1a9e req-c555414d-3216-4321-9767-27a0d2efe4cc tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (29a4c30f-5dee-44f8-9d38-871d403dcfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383394c9-31e2-4a85-ad60-416eeeaf8bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383394c9-31e2-4a85-ad60-416eeeaf8bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302197799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd0ddce-bcae-4c17-b966-78355e807a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:29Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b33fd7-e627-42b6-9d40-13f5295a1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b33fd7-e627-42b6-9d40-13f5295a1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233a6c55-7dec-49b8-8d12-1bcc4954c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233a6c55-7dec-49b8-8d12-1bcc4954c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd0ddce-bcae-4c17-b966-78355e807a7e', 'volume_name': 'volume-fbd0ddce-bcae-4c17-b966-78355e807a7e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17660739-edd7-4612-8787-64cb3ed11e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17660739-edd7-4612-8787-64cb3ed11e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06451e59-7cc4-4c85-8723-46d16cb1b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume fbd0ddce-bcae-4c17-b966-78355e807a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd0ddce-bcae-4c17-b966-78355e807a7e', 'volume_size': 1} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:29 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c 1073741824" returned: 0 in 0.662s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c Jul 23 03:33:29 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (9b053d98-66c1-4c23-8155-9bc4128f0a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3594790-40e1-4ee4-9d59-b1a052dd518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3594790-40e1-4ee4-9d59-b1a052dd518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078129994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d43d438-8e62-416f-bce4-128810de7c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:30Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d564cf70-4bef-4a52-9d25-c7f1b2589642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d564cf70-4bef-4a52-9d25-c7f1b2589642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac62c57-9aa1-422b-be70-579123230b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac62c57-9aa1-422b-be70-579123230b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d43d438-8e62-416f-bce4-128810de7c7a', 'volume_name': 'volume-8d43d438-8e62-416f-bce4-128810de7c7a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4da142b-2cc2-4f21-b95f-ea57c8a18470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4da142b-2cc2-4f21-b95f-ea57c8a18470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37690ee4-1647-45ee-b99e-bcf9269e0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume 8d43d438-8e62-416f-bce4-128810de7c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d43d438-8e62-416f-bce4-128810de7c7a', 'volume_size': 1} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:29 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c" returned: 0 in 0.338s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509150820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ecf056-dfa0-49e4-bc28-be1b8bea503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume f0ecf056-dfa0-49e4-bc28-be1b8bea503e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:29 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec6f6a-4fbd-4444-a1b5-b06da9a9bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a603e597-116c-4fac-a2b2-59905d4c1b0c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:29 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e 1073741824 Jul 23 03:33:29 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e72388c-973b-4567-8928-2a002d381108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-a603e597-116c-4fac-a2b2-59905d4c1b0c (a603e597-116c-4fac-a2b2-59905d4c1b0c): created successfully Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e72388c-973b-4567-8928-2a002d381108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (8c09f903-9211-4c72-a9f8-d348771d1efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8edba7fb-5d21-4371-9d7d-6529771b32f7 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:30 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e 1073741824" returned: 0 in 0.424s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e Jul 23 03:33:30 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" returned: 0 in 0.282s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e8213c42-59ac-43b7-a21b-bca071ff1a9e req-c555414d-3216-4321-9767-27a0d2efe4cc tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.552s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e8213c42-59ac-43b7-a21b-bca071ff1a9e req-c555414d-3216-4321-9767-27a0d2efe4cc tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302197799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd0ddce-bcae-4c17-b966-78355e807a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:29Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume fbd0ddce-bcae-4c17-b966-78355e807a7e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:30 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a1f3f7-467b-41f6-a970-1daf6b4fb798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a01592-a45a-4151-a1aa-fb274c3ea679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e 1073741824 Jul 23 03:33:30 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e (f0ecf056-dfa0-49e4-bc28-be1b8bea503e): created successfully Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a01592-a45a-4151-a1aa-fb274c3ea679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (22e5679e-7648-4427-af1f-119ea0fc4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e8213c42-59ac-43b7-a21b-bca071ff1a9e req-c555414d-3216-4321-9767-27a0d2efe4cc tempest-TestInstancesWithCinderVolumes-945876302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3886e119-cd2b-4b7a-8c9f-d4672642c01f', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:33:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c870e4be-a0b9-473c-b0d3-01859d799544 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e8213c42-59ac-43b7-a21b-bca071ff1a9e req-c555414d-3216-4321-9767-27a0d2efe4cc tempest-TestInstancesWithCinderVolumes-945876302 None] attachment_update completed successfully. Jul 23 03:33:31 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e 1073741824" returned: 0 in 0.601s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:31 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e Jul 23 03:33:31 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:31 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e" returned: 0 in 0.377s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078129994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d43d438-8e62-416f-bce4-128810de7c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf518f91d1245ecadacda24110fc9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:30Z,use_quota=True,user_id='475c083f9a844c79986c7d8c86498ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Creating volume 8d43d438-8e62-416f-bce4-128810de7c7a {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:31 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06451e59-7cc4-4c85-8723-46d16cb1b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd0ddce-bcae-4c17-b966-78355e807a7e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a 1073741824 Jul 23 03:33:31 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7136deb7-1616-4e62-a68b-9cb3ef002d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-fbd0ddce-bcae-4c17-b966-78355e807a7e (fbd0ddce-bcae-4c17-b966-78355e807a7e): created successfully Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7136deb7-1616-4e62-a68b-9cb3ef002d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (29a4c30f-5dee-44f8-9d38-871d403dcfc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-eaa8022f-d8af-458b-82e9-52b444412633 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:32 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a 1073741824" returned: 0 in 0.595s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:32 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a Jul 23 03:33:32 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:32 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a" returned: 0 in 0.347s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37690ee4-1647-45ee-b99e-bcf9269e0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d43d438-8e62-416f-bce4-128810de7c7a', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a959e2-e561-4fd4-85ae-0a7cb6720749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Volume volume-8d43d438-8e62-416f-bce4-128810de7c7a (8d43d438-8e62-416f-bce4-128810de7c7a): created successfully Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a959e2-e561-4fd4-85ae-0a7cb6720749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Flow 'volume_create_manager' (9b053d98-66c1-4c23-8155-9bc4128f0a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-56463e69-067d-48e7-aa64-87c1ce68ae87 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created volume successfully. Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-8d43d438-8e62-416f-bce4-128810de7c7a-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-8d43d438-8e62-416f-bce4-128810de7c7a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-8d43d438-8e62-416f-bce4-128810de7c7a" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-8d43d438-8e62-416f-bce4-128810de7c7a" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d0c48c-11b4-469c-8f03-5570268a470f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:33 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a Jul 23 03:33:33 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:34 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:34 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a Jul 23 03:33:34 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:34 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-8d43d438-8e62-416f-bce4-128810de7c7a" returned: 0 in 0.297s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-8d43d438-8e62-416f-bce4-128810de7c7a" released by "delete_volume" :: held 0.818s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['f102bb1b-9726-49bf-8682-caa5e7af4f82', '6ed9d98d-0f71-46b6-b583-b66a912c7cd5', 'b64d20bd-4e81-47bc-bbf0-1e506d4403e2', '5565732e-5955-43d4-8af3-4a04d9cd7ac3'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:34 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:34 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-fbd0ddce-bcae-4c17-b966-78355e807a7e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-fbd0ddce-bcae-4c17-b966-78355e807a7e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-fbd0ddce-bcae-4c17-b966-78355e807a7e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-fbd0ddce-bcae-4c17-b966-78355e807a7e" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d2f65-e3b2-4329-9231-c5b0cdfa6d2f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:34 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a183cc60-dbdf-4061-99a9-9430017f3b6c tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-8d43d438-8e62-416f-bce4-128810de7c7a-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:35 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e Jul 23 03:33:35 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:35 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e" returned: 0 in 0.426s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:35 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e Jul 23 03:33:35 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:35 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fbd0ddce-bcae-4c17-b966-78355e807a7e" returned: 0 in 0.291s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-fbd0ddce-bcae-4c17-b966-78355e807a7e" released by "delete_volume" :: held 0.764s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['ae7e134a-22c9-409c-b557-25cc09790f38', '6987a651-f0de-4c4d-a4b1-a10a25f834f2', 'c298bc4d-1dcf-41a0-9fab-9afd252a1777', 'c1a409dd-bc96-4c60-8c4e-3c652e06c712'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:35 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:35 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:35 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:35 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-f0ecf056-dfa0-49e4-bc28-be1b8bea503e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-f0ecf056-dfa0-49e4-bc28-be1b8bea503e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d9ef6-396a-47a8-b585-823bbf794821]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.383s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b9d1d7e6-2d22-45ff-8aff-45da90f96a8b tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-fbd0ddce-bcae-4c17-b966-78355e807a7e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:36 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:33:36 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e Jul 23 03:33:36 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" returned: 0 in 0.481s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e Jul 23 03:33:36 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-3336167c-779d-471a-bfb6-e8c76ff90cde req-96ccb637-1bfd-4fbb-a88d-9f383c8021b1 tempest-TestInstancesWithCinderVolumes-945876302 None] Terminate volume connection completed successfully. Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-3336167c-779d-471a-bfb6-e8c76ff90cde req-96ccb637-1bfd-4fbb-a88d-9f383c8021b1 tempest-TestInstancesWithCinderVolumes-945876302 None] Deleting attachment 7004e3ca-33b2-48ef-abf2-90e8914f0ed3. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:33:36 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" returned: 0 in 0.295s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-f0ecf056-dfa0-49e4-bc28-be1b8bea503e" released by "delete_volume" :: held 0.827s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['c234f949-bd23-4fd9-a0f1-61b895756f2d', '79088708-323b-4db6-9d81-fa6466b8c94b', '700b9d70-06db-413f-ba00-a5df28241375', '1e5fcf6e-f1bb-4b75-9ea1-f2ca25024fea'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:37 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:37 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-a603e597-116c-4fac-a2b2-59905d4c1b0c-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-a603e597-116c-4fac-a2b2-59905d4c1b0c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-a603e597-116c-4fac-a2b2-59905d4c1b0c" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-a603e597-116c-4fac-a2b2-59905d4c1b0c" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87ddaef-d161-4f6f-86fd-38d5ca34d6ad]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:37 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c Jul 23 03:33:37 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:37 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.325s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e44c5578-436b-4113-903c-9ff137a6d26e tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-f0ecf056-dfa0-49e4-bc28-be1b8bea503e-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-d61a27c6-3562-47dd-85d9-3234a803b107-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-d61a27c6-3562-47dd-85d9-3234a803b107-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-quobyte-d61a27c6-3562-47dd-85d9-3234a803b107" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-d61a27c6-3562-47dd-85d9-3234a803b107" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e841d0-66c2-4fba-9635-bb3a0a46ac35]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:37 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c" returned: 0 in 0.422s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:37 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 Jul 23 03:33:37 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:37 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c Jul 23 03:33:37 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a603e597-116c-4fac-a2b2-59905d4c1b0c" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-a603e597-116c-4fac-a2b2-59905d4c1b0c" released by "delete_volume" :: held 0.792s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:38 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107 Jul 23 03:33:38 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['ed1ed6d3-828e-4797-ab30-9e7299de9681', '19e9bc87-3841-4c0c-bef5-f70107d852a6', 'e833f033-bb2d-48df-b222-0776765a0e53', '05134ea7-ae71-4f64-9003-de8064d25f5e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:38 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-b1748671-f769-46d2-b049-e07241b9166f-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-b1748671-f769-46d2-b049-e07241b9166f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:38 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d61a27c6-3562-47dd-85d9-3234a803b107" returned: 0 in 0.376s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-d61a27c6-3562-47dd-85d9-3234a803b107" released by "delete_volume" :: held 0.945s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-b1748671-f769-46d2-b049-e07241b9166f" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-b1748671-f769-46d2-b049-e07241b9166f" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7287cb95-8a8e-4850-9d78-d826b5c34252]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack cinder-volume[88044]: WARNING cinder.quota [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961875423-1280706956 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961875423-1280706956, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:38 devstack cinder-volume[88044]: WARNING cinder.quota [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961875423-1280706956 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961875423-1280706956, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Created reservations ['bcb77d0a-6fa5-4ac9-8d16-de4ca86585ab', 'edb38356-d8be-4ef7-add9-f7705528978a', 'bcb12d4b-c8a3-4e35-97db-57d076685223', '7765b66b-293b-45a9-81bf-50f5a9d697a8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:38 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.441s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4ae509f3-a532-476b-ad65-5e8602f9a985 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-a603e597-116c-4fac-a2b2-59905d4c1b0c-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:38 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f Jul 23 03:33:38 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:38 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:39 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Deleted volume successfully. Jul 23 03:33:39 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f" returned: 0 in 0.578s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-573681ce-8551-4f7d-8164-e6de8f7b544f tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-d61a27c6-3562-47dd-85d9-3234a803b107-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:39 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f Jul 23 03:33:39 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:39 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b1748671-f769-46d2-b049-e07241b9166f" returned: 0 in 0.259s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-b1748671-f769-46d2-b049-e07241b9166f" released by "delete_volume" :: held 0.891s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['92db87c9-c056-4e3e-8ffd-1f4629d65abb', '19207e93-71a1-4b99-accf-2ae688769bed', '8d6f1704-9f0d-4938-bad7-bbbf32ee5a26', '08417520-1c09-4573-ae0c-dff5701705b4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:39 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:39 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:39 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.264s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-71edcd9d-1c89-482e-8d9a-5b8986c34dd0 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-b1748671-f769-46d2-b049-e07241b9166f-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-1a74481b-c80a-44a0-9c4d-38edb581aa2d-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-1a74481b-c80a-44a0-9c4d-38edb581aa2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-1a74481b-c80a-44a0-9c4d-38edb581aa2d" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-1a74481b-c80a-44a0-9c4d-38edb581aa2d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleting offline snapshot 1a74481b-c80a-44a0-9c4d-38edb581aa2d of volume 0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] snapshot_file for this snap is: volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9391b7-9cdb-477e-ba07-9d3319c9f200]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:40 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d Jul 23 03:33:40 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc1f776-a888-4c43-868a-092b1e82b2d1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:41 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 Jul 23 03:33:41 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" returned: 0 in 0.400s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:41 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d Jul 23 03:33:41 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-c29a36a1-72b6-4a73-b1a5-3cc72d53dc32 req-841de3d4-aa1b-49ac-bfbd-9c9a5d99368d tempest-TestInstancesWithCinderVolumes-945876302 None] Terminate volume connection completed successfully. Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-c29a36a1-72b6-4a73-b1a5-3cc72d53dc32 req-841de3d4-aa1b-49ac-bfbd-9c9a5d99368d tempest-TestInstancesWithCinderVolumes-945876302 None] Deleting attachment 3886e119-cd2b-4b7a-8c9f-d4672642c01f. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:33:41 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d" returned: 0 in 0.389s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:42 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d Jul 23 03:33:42 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:42 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2.1a74481b-c80a-44a0-9c4d-38edb581aa2d" returned: 0 in 0.282s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-1a74481b-c80a-44a0-9c4d-38edb581aa2d" released by "_delete_snapshot" :: held 1.600s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" released by "delete_snapshot" :: held 1.627s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-fe8e5d88-e55d-4196-9b2f-b27eff9989b6-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-fe8e5d88-e55d-4196-9b2f-b27eff9989b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-quobyte-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['1b927a51-d98b-4138-b363-5161efbfd048', 'a0298d91-502c-4092-a9f4-d930281b13dd', '21870ace-720d-4afd-9cb5-8a9d909d9c34', 'd38353af-ace0-4197-9568-33bde66196cd'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e140314f-2337-47cc-bb0c-7e18213c4a90]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Delete snapshot completed successfully. Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-433abb99-c4ce-4f61-bce6-2dbc4503b897 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-1a74481b-c80a-44a0-9c4d-38edb581aa2d-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:42 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 Jul 23 03:33:42 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:42 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" returned: 0 in 0.488s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5a235-109d-4e0b-8143-4e10f4f79da2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:42 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6 Jul 23 03:33:42 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:43 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 Jul 23 03:33:43 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:43 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-fe8e5d88-e55d-4196-9b2f-b27eff9989b6" released by "delete_volume" :: held 0.838s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:43 devstack cinder-volume[88044]: WARNING cinder.quota [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1969673578-1033487088 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1969673578-1033487088, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:43 devstack cinder-volume[88044]: WARNING cinder.quota [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1969673578-1033487088 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1969673578-1033487088, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Created reservations ['c0ebd53a-4b40-443e-bc5e-2dd6c97f1012', '7a3ec1c0-6299-4325-9c65-842d54c60783', '40ada1bb-2544-4b5b-9f01-d10178ea0e93', '981ea9d1-45df-4bb7-8433-28439a3c9c37'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:43 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" returned: 0 in 0.486s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:43 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:43 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:43 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2 Jul 23 03:33:43 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:43 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Deleted volume successfully. Jul 23 03:33:43 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" returned: 0 in 0.383s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-quobyte-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2" released by "delete_volume" :: held 0.954s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dde37618-0777-4c56-8dd6-b25d76f769df tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-fe8e5d88-e55d-4196-9b2f-b27eff9989b6-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:43 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Created reservations ['6d05c172-f4f1-4951-ae6a-7c34514c5bcb', 'd886aad7-12a5-4058-994f-9799318765e5', '8d6a1ed9-7c11-45ae-ab73-c56f345eefd1', '79bdf728-9cef-40ca-9d89-05649727b565'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:44 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:44 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:44 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Deleted volume successfully. Jul 23 03:33:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0d86a86f-91fd-41d7-91bb-85b447e0dc68 tempest-CreateVolumesFromSnapshotTest-1272026954 None] Lock "cinder-0d86a61d-78af-46fd-b8fd-e1b7780fa8a2-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-674ab81b-81b8-4d1e-b7bd-70499e718930 req-b9d56202-4193-41e1-a44e-311c1044edec tempest-TestInstancesWithCinderVolumes-945876302 None] Terminate volume connection completed successfully. Jul 23 03:33:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-674ab81b-81b8-4d1e-b7bd-70499e718930 req-b9d56202-4193-41e1-a44e-311c1044edec tempest-TestInstancesWithCinderVolumes-945876302 None] Deleting attachment 54c990c6-a027-4b33-a3a1-56c2c08e79cd. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f88d25-f305-42b6-938c-740a6484ce0f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:48 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 Jul 23 03:33:48 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:48 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93" returned: 0 in 0.402s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.434s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-e592ec70-be1f-4772-a12f-13ac89b8bc93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b49fcd0-3d64-4588-8bd4-3b5385a8713f', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:33:49 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-9b5449ee-af2a-478a-9131-9c01ab33b6c6 req-4c0fee2e-8c51-4c9a-8d5d-71f6f62ffeec tempest-TestStampPattern-382813522 None] attachment_update completed successfully. Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-b17a1633-d507-4a82-b39b-12789d0d1304-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-b17a1633-d507-4a82-b39b-12789d0d1304-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "cinder-quobyte-b17a1633-d507-4a82-b39b-12789d0d1304" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-b17a1633-d507-4a82-b39b-12789d0d1304" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b901f447-1da2-42e4-a0e8-eddb87fd6d8a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:49 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 Jul 23 03:33:49 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:50 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:50 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304 Jul 23 03:33:50 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:50 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b17a1633-d507-4a82-b39b-12789d0d1304" returned: 0 in 0.281s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-quobyte-b17a1633-d507-4a82-b39b-12789d0d1304" released by "delete_volume" :: held 0.846s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:50 devstack cinder-volume[88044]: WARNING cinder.quota [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246790216-499615430 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246790216-499615430, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:50 devstack cinder-volume[88044]: WARNING cinder.quota [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246790216-499615430 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246790216-499615430, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Created reservations ['bb3e9f01-ce11-410a-bed0-53bd74b99586', 'afc0543b-0f2d-471d-afed-81a2cbf6341f', 'c6f18c9b-e4ea-42be-ad5e-617b4b432b7e', '4e294878-033d-4881-bc8b-2925598a2cc0'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:50 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:33:50 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:50 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:50 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Deleted volume successfully. Jul 23 03:33:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-81be1331-feaa-456f-9498-2c204c021d67 tempest-TestInstancesWithCinderVolumes-945876302 None] Lock "cinder-b17a1633-d507-4a82-b39b-12789d0d1304-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e1adb88c-857e-4abc-af78-423aafb31600 req-99a9e563-cfed-405e-8f31-f0e5785f94f3 tempest-TestStampPattern-382813522 None] Terminate volume connection completed successfully. Jul 23 03:33:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e1adb88c-857e-4abc-af78-423aafb31600 req-99a9e563-cfed-405e-8f31-f0e5785f94f3 tempest-TestStampPattern-382813522 None] Deleting attachment 6b49fcd0-3d64-4588-8bd4-3b5385a8713f. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-e592ec70-be1f-4772-a12f-13ac89b8bc93-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "cinder-e592ec70-be1f-4772-a12f-13ac89b8bc93-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[da319726-563c-475f-b7e1-160fb1b5d022]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:01 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 Jul 23 03:34:01 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:01 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93" returned: 0 in 0.532s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:01 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93 Jul 23 03:34:01 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:02 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e592ec70-be1f-4772-a12f-13ac89b8bc93" returned: 0 in 0.320s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-e592ec70-be1f-4772-a12f-13ac89b8bc93" released by "delete_volume" :: held 0.946s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Created reservations ['d133a7c5-d52c-4b38-904a-1ea4512d0c70', '517efd94-c831-4f82-95b9-f2e2a27717fc', '10b41419-66bb-4d0f-b605-822038f0fc51', '730150a3-8fa2-4692-b35d-3a689524d6f2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:02 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:02 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:02 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.400s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Deleted volume successfully. Jul 23 03:34:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-7a83c909-e06e-40c9-951a-04279f0033ec tempest-TestStampPattern-382813522 None] Lock "cinder-e592ec70-be1f-4772-a12f-13ac89b8bc93-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Deleting offline snapshot a42e05ac-26ee-4f52-bb94-9dea29bc63a8 of volume 98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] snapshot_file for this snap is: volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e75a7e-f2a0-431c-bbb7-8b42c6972bcf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:03 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:34:03 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:04 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.560s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a237b4-c76a-4e87-9e00-f2065e1076b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[228084e6-cb67-4c3f-8005-1d2a1b495357]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:04 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:34:04 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:04 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:04 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:34:04 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:05 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.411s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:05 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8 Jul 23 03:34:05 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:05 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3.a42e05ac-26ee-4f52-bb94-9dea29bc63a8" returned: 0 in 0.307s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=102,cinder:UPDATE=111,cinder:INSERT=28,cinder:DELETE=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-a42e05ac-26ee-4f52-bb94-9dea29bc63a8" released by "_delete_snapshot" :: held 1.906s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" released by "delete_snapshot" :: held 1.942s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Created reservations ['f121076f-c190-441f-bd8b-3a37d87d4328', '8600c947-33f0-407b-968e-615bb3c79958', 'efba5aa8-0e78-4dcb-8ead-6aecb2a9ebd2', '4a1e3acb-fa19-4f57-b006-5ac09e6bd69f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=113,cinder:SELECT=98,cinder:DELETE=11,cinder:INSERT=26 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Delete snapshot completed successfully. Jul 23 03:34:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-14e27d1f-df33-4e61-b95b-29c0c28a1693 tempest-TestStampPattern-382813522 None] Lock "cinder-a42e05ac-26ee-4f52-bb94-9dea29bc63a8-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-98a237b4-c76a-4e87-9e00-f2065e1076b3-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "cinder-98a237b4-c76a-4e87-9e00-f2065e1076b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Acquiring lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51bad6b-1edd-4cf3-aa35-bf609cb115f7]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:34:13 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.438s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3 Jul 23 03:34:13 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98a237b4-c76a-4e87-9e00-f2065e1076b3" returned: 0 in 0.307s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "cinder-quobyte-98a237b4-c76a-4e87-9e00-f2065e1076b3" released by "delete_volume" :: held 0.829s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Created reservations ['f274b6be-733e-4d4a-9465-65554feece55', '2105e93a-9136-4d0f-a298-1ac638ac3fbb', 'cd3f1065-bcfd-45fd-9325-2a1f6aa389fc', 'e7051d80-ea2b-434f-b40f-414a307a8176'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:14 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.362s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Deleted volume successfully. Jul 23 03:34:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9883ec7a-5005-438b-ba9f-ff29b301b988 tempest-TestStampPattern-382813522 None] Lock "cinder-98a237b4-c76a-4e87-9e00-f2065e1076b3-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Flow 'volume_create_manager' (03a06477-ab50-4bc7-94b0-71d2ce4a7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c536841-94fa-4eeb-91c1-8830e3cd69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c536841-94fa-4eeb-91c1-8830e3cd69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454555728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd9595-b5f2-4783-84f8-a3ee6e43247d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e2e54260e14316b2d80e79c4338e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:17Z,use_quota=True,user_id='9a27fad5078e4732bb3118d4f64db80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c8e69a-5eba-42e5-a7d1-050982d3b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c8e69a-5eba-42e5-a7d1-050982d3b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6221b-695e-4c5f-a2d3-f2ca89cb3cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6221b-695e-4c5f-a2d3-f2ca89cb3cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cd9595-b5f2-4783-84f8-a3ee6e43247d', 'volume_name': 'volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b237b03b-4f8c-4434-bd07-2e160c0be6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b237b03b-4f8c-4434-bd07-2e160c0be6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6b81bd-96be-4a30-964b-b7870970b2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Volume b7cd9595-b5f2-4783-84f8-a3ee6e43247d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d', 'volume_size': 1} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454555728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd9595-b5f2-4783-84f8-a3ee6e43247d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e2e54260e14316b2d80e79c4338e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:17Z,use_quota=True,user_id='9a27fad5078e4732bb3118d4f64db80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Creating volume b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:17 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:34:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d 1073741824 Jul 23 03:34:17 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d 1073741824" returned: 0 in 0.590s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:18 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:18 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6b81bd-96be-4a30-964b-b7870970b2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fada2ff2-9781-4acc-b361-55ec112d62d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:18 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Volume volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d (b7cd9595-b5f2-4783-84f8-a3ee6e43247d): created successfully Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fada2ff2-9781-4acc-b361-55ec112d62d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Flow 'volume_create_manager' (03a06477-ab50-4bc7-94b0-71d2ce4a7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:18 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51ceb68d-6480-41b1-8a9b-3e72dabd5641 tempest-SnapshotDependencyTests-515291906 None] Created volume successfully. Jul 23 03:34:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:19 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Creating offline snapshot 02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 of volume b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f437d37f-7a4b-4a5a-b207-22ab4f02e13f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:19 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:20 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.420s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:20 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 1G Jul 23 03:34:20 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:20 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 1G" returned: 0 in 0.554s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:20 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:20 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:21 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.515s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:21 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 is being set with open permissions: ugo+rw Jul 23 03:34:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:21 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:21 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info Jul 23 03:34:21 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info is being set with open permissions: ugo+rw Jul 23 03:34:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:22 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info Jul 23 03:34:22 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.info" returned: 0 in 0.309s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c6062a62-7d3a-47fc-a352-032c9341035e tempest-SnapshotDependencyTests-515291906 None] Create snapshot completed successfully Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Flow 'volume_create_manager' (5d64d99c-44af-42a6-b78f-49e941497174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1624d-953f-4f33-8633-dc8de84a4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1624d-953f-4f33-8633-dc8de84a4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428c5fcf-9a94-4411-90cf-e139c034f6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e2e54260e14316b2d80e79c4338e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02a082b2-3b7b-4d83-b138-8d0c2cd7dd79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:24Z,use_quota=True,user_id='9a27fad5078e4732bb3118d4f64db80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46938039-8407-43e1-b796-fcea258757d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46938039-8407-43e1-b796-fcea258757d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a77280-fee3-4b37-b05f-2e890a8da439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a77280-fee3-4b37-b05f-2e890a8da439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '428c5fcf-9a94-4411-90cf-e139c034f6bc', 'volume_name': 'volume-428c5fcf-9a94-4411-90cf-e139c034f6bc', 'volume_size': 1, 'snapshot_id': '02a082b2-3b7b-4d83-b138-8d0c2cd7dd79'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3f6e3-792c-406b-b9b0-65a49b43eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3f6e3-792c-406b-b9b0-65a49b43eed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da249eb-a852-443c-8f6a-23b934658e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Volume 428c5fcf-9a94-4411-90cf-e139c034f6bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-428c5fcf-9a94-4411-90cf-e139c034f6bc', 'volume_size': 1, 'snapshot_id': '02a082b2-3b7b-4d83-b138-8d0c2cd7dd79'} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-428c5fcf-9a94-4411-90cf-e139c034f6bc" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-428c5fcf-9a94-4411-90cf-e139c034f6bc" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Creating volume 428c5fcf-9a94-4411-90cf-e139c034f6bc from snapshot 02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] snapshot: 02a082b2-3b7b-4d83-b138-8d0c2cd7dd79, volume: 428c5fcf-9a94-4411-90cf-e139c034f6bc, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afbc1ca-ce64-4ec1-8014-f60de8e9f7f4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:24 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:24 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:24 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.520s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437b00c-a3a1-4f6b-b37b-4841adca0c0b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:24 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:24 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.482s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:25 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:34:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc Jul 23 03:34:25 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:31 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc" returned: 0 in 5.963s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475cc29-fddc-4061-8a9b-1608a635965a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:31 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:31 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:31 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.728s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:34:31 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Converted 1024.00 MB image at 171.69 MB/s Jul 23 03:34:31 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc is being set with open permissions: ugo+rw Jul 23 03:34:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:31 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc Jul 23 03:34:31 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc" returned: 0 in 0.354s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" released by "_copy_volume_from_snapshot" :: held 8.189s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-428c5fcf-9a94-4411-90cf-e139c034f6bc" released by "_create_volume_from_snapshot" :: held 8.230s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.256s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da249eb-a852-443c-8f6a-23b934658e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428c5fcf-9a94-4411-90cf-e139c034f6bc', 'volume_size': 1, 'snapshot_id': '02a082b2-3b7b-4d83-b138-8d0c2cd7dd79'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376e829e-8664-459e-bdf1-e89846a4e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:32 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Volume volume-428c5fcf-9a94-4411-90cf-e139c034f6bc (428c5fcf-9a94-4411-90cf-e139c034f6bc): created successfully Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376e829e-8664-459e-bdf1-e89846a4e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:32 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Flow 'volume_create_manager' (5d64d99c-44af-42a6-b78f-49e941497174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-035e2b32-e1ae-4983-833a-2cbfa457c6f5 tempest-SnapshotDependencyTests-515291906 None] Created volume successfully. Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Deleting offline snapshot 02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 of volume b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] snapshot_file for this snap is: volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d9bb2d-e96f-4010-982e-85edefd6b2a8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:33 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.510s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e4d1f-84a2-420b-b106-e60272f31d17]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:34 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:34 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.442s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79 Jul 23 03:34:35 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d.02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" returned: 0 in 0.290s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79" released by "_delete_snapshot" :: held 1.870s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" released by "delete_snapshot" :: held 1.897s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Created reservations ['b29120ea-b014-410f-95f3-61143b51e4ae', '8dc96b03-7e96-4a50-b39b-775d79cea22d', '034233cc-9af3-4f82-8f95-5673aef5577b', 'b4dd6c41-81f8-4af8-a1bb-00c36c1fdfe3'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Delete snapshot completed successfully. Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-02960821-5277-4155-a0f8-71d7ed35e64c tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-02a082b2-3b7b-4d83-b138-8d0c2cd7dd79-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-b7cd9595-b5f2-4783-84f8-a3ee6e43247d-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-b7cd9595-b5f2-4783-84f8-a3ee6e43247d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cca123-1af5-425f-b1e8-41171abbaad9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:35 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:35 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:36 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.408s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:34:36 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.520s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:36 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d Jul 23 03:34:36 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:36 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-b7cd9595-b5f2-4783-84f8-a3ee6e43247d" released by "delete_volume" :: held 0.964s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Created reservations ['2d7e3650-fb98-4857-a57a-c05c4717732e', 'b8a93c35-d3ab-4841-bafc-783d0dff9daf', 'd20a9ed3-04c0-4b06-80e9-8f7aebf1aeb7', 'fbcfb6fc-aece-43ce-8f51-039799990f14'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:36 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:36 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:37 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.298s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Deleted volume successfully. Jul 23 03:34:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8882fdf9-96f9-4c04-a1d6-a771a7226a00 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-b7cd9595-b5f2-4783-84f8-a3ee6e43247d-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-428c5fcf-9a94-4411-90cf-e139c034f6bc-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-428c5fcf-9a94-4411-90cf-e139c034f6bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c1651-19b6-4a07-975c-344685fb3694]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:38 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc Jul 23 03:34:38 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:38 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc" returned: 0 in 0.442s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:38 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc Jul 23 03:34:38 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:38 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-428c5fcf-9a94-4411-90cf-e139c034f6bc" returned: 0 in 0.405s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-quobyte-428c5fcf-9a94-4411-90cf-e139c034f6bc" released by "delete_volume" :: held 0.936s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Flow 'volume_create_manager' (75861d79-1b3f-4be8-8ff8-f486fa74e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a7547b-fddf-4fee-8c62-4a0a08fdd1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a7547b-fddf-4fee-8c62-4a0a08fdd1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-184140114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cef36-7977-45a7-9eb6-84c3c29d0ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eac33a3db84b508846e1f22407f540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:39Z,use_quota=True,user_id='053f185d8eed459a816f1e7b1319c08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc5de23-02ad-41fb-9731-9ce0960b08a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc5de23-02ad-41fb-9731-9ce0960b08a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b325ba34-8503-44bf-b735-bf1b46ee6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b325ba34-8503-44bf-b735-bf1b46ee6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947cef36-7977-45a7-9eb6-84c3c29d0ccb', 'volume_name': 'volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2a0555-f403-4dff-99cc-53962bff32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2a0555-f403-4dff-99cc-53962bff32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441b614e-7850-40c9-8bc0-78b2b1a12e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume 947cef36-7977-45a7-9eb6-84c3c29d0ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb', 'volume_size': 1} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-184140114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cef36-7977-45a7-9eb6-84c3c29d0ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eac33a3db84b508846e1f22407f540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:39Z,use_quota=True,user_id='053f185d8eed459a816f1e7b1319c08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Creating volume 947cef36-7977-45a7-9eb6-84c3c29d0ccb {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:39 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Created reservations ['5aef6750-6ae2-490a-9724-2406f13e580e', '375511f0-ddd6-49e8-8c6f-955435193e8c', '4f16b6b7-9a9a-4606-b9cb-81fee8bf300d', 'bfc0c3f3-c04d-496e-b4ca-8ddcc0d82c0c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:39 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb 1073741824 Jul 23 03:34:39 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:39 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:39 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Flow 'volume_create_manager' (3e9a7cbe-9904-4b5d-a57e-eaef9ea5c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6132fe8-91a6-48c8-95cc-15797c378f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6132fe8-91a6-48c8-95cc-15797c378f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-562197542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57578b3e-1be4-4c60-bad5-53562c128a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eac33a3db84b508846e1f22407f540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:39Z,use_quota=True,user_id='053f185d8eed459a816f1e7b1319c08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ea2c11-06e7-418b-995d-0becff94483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ea2c11-06e7-418b-995d-0becff94483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce09640-d23f-4cd6-a47f-65fac00d9276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce09640-d23f-4cd6-a47f-65fac00d9276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57578b3e-1be4-4c60-bad5-53562c128a89', 'volume_name': 'volume-57578b3e-1be4-4c60-bad5-53562c128a89', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32328ee4-8c61-4bb5-b00a-c363843e4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32328ee4-8c61-4bb5-b00a-c363843e4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7df8e-1590-447d-8bb3-55879b290401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume 57578b3e-1be4-4c60-bad5-53562c128a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57578b3e-1be4-4c60-bad5-53562c128a89', 'volume_size': 1} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb 1073741824" returned: 0 in 0.741s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:39 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.571s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Deleted volume successfully. Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-74733e86-7c85-49b2-9a0d-1a5c6fb938c6 tempest-SnapshotDependencyTests-515291906 None] Lock "cinder-428c5fcf-9a94-4411-90cf-e139c034f6bc-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:40 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb Jul 23 03:34:40 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb" returned: 0 in 0.348s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-562197542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57578b3e-1be4-4c60-bad5-53562c128a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eac33a3db84b508846e1f22407f540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:39Z,use_quota=True,user_id='053f185d8eed459a816f1e7b1319c08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Creating volume 57578b3e-1be4-4c60-bad5-53562c128a89 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:40 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 1073741824 Jul 23 03:34:40 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441b614e-7850-40c9-8bc0-78b2b1a12e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f254b6-4e7f-42f3-923f-9acbbea1cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:40 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb (947cef36-7977-45a7-9eb6-84c3c29d0ccb): created successfully Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f254b6-4e7f-42f3-923f-9acbbea1cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Flow 'volume_create_manager' (75861d79-1b3f-4be8-8ff8-f486fa74e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f0000850-f526-4f24-a32d-ebd6c5a05db3 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Created volume successfully. Jul 23 03:34:41 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 1073741824" returned: 0 in 0.674s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Flow 'volume_create_manager' (3973e084-78ad-40d4-851e-09bae4a34fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be35dc1d-0671-4e3e-ab77-a34eda96040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be35dc1d-0671-4e3e-ab77-a34eda96040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956116ab-0d50-4f51-a909-6d60daec2935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a19e56089bf8407e98bd4a958ce061ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:41Z,use_quota=True,user_id='c08e83f3f4554c4796dac0e9deb759e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae0d74c-6a50-40be-a670-c552ccff3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae0d74c-6a50-40be-a670-c552ccff3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b88b36-9df7-434b-8f1a-6dbe63c364a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 Jul 23 03:34:41 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b88b36-9df7-434b-8f1a-6dbe63c364a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '956116ab-0d50-4f51-a909-6d60daec2935', 'volume_name': 'volume-956116ab-0d50-4f51-a909-6d60daec2935', 'volume_size': 1, 'image_id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436000e6e3f6558e1e59021c47df272c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a19e56089bf8407e98bd4a958ce061ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60806cd5bae27ee0871a8b987ae6cf1c7913308927010569fe4c184f3122e37316915900260101f0bb743930471841a46edf69d309048aaef63e38338a29e9e', 'id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d0672f-71e9-439e-848d-b5cd5a256792/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345f4bb7-a0fe-421d-adc6-5b117d1a7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345f4bb7-a0fe-421d-adc6-5b117d1a7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd02419-4089-4aad-8e04-46533b9185ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Volume 956116ab-0d50-4f51-a909-6d60daec2935: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-956116ab-0d50-4f51-a909-6d60daec2935', 'volume_size': 1, 'image_id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436000e6e3f6558e1e59021c47df272c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a19e56089bf8407e98bd4a958ce061ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60806cd5bae27ee0871a8b987ae6cf1c7913308927010569fe4c184f3122e37316915900260101f0bb743930471841a46edf69d309048aaef63e38338a29e9e', 'id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d0672f-71e9-439e-848d-b5cd5a256792/file', 'properties': {}}, 'image_service': } Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Trying to clone 956116ab-0d50-4f51-a909-6d60daec2935 from image 25d0672f-71e9-439e-848d-b5cd5a256792 at location (None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:34:41 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89" returned: 0 in 0.351s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7df8e-1590-447d-8bb3-55879b290401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57578b3e-1be4-4c60-bad5-53562c128a89', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8783635a-a496-492e-a740-f350f644466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Volume volume-57578b3e-1be4-4c60-bad5-53562c128a89 (57578b3e-1be4-4c60-bad5-53562c128a89): created successfully Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8783635a-a496-492e-a740-f350f644466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Flow 'volume_create_manager' (3e9a7cbe-9904-4b5d-a57e-eaef9ea5c32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3d08ad3f-1ffd-4cd5-92ed-91449f5ad474 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Created volume successfully. Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:34:41 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[31511356-0b3d-4269-b515-6649bf96c809]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:41 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:42 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:42 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:42 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:42 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Temporary image 25d0672f-71e9-439e-848d-b5cd5a256792 is fetched for user c08e83f3f4554c4796dac0e9deb759e6. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb868be-134d-4052-a290-00ede5001beb]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:42 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:42 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:43 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956116ab-0d50-4f51-a909-6d60daec2935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a19e56089bf8407e98bd4a958ce061ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:41Z,use_quota=True,user_id='c08e83f3f4554c4796dac0e9deb759e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Creating volume 956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:43 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:34:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1073741824 Jul 23 03:34:43 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1073741824" returned: 0 in 0.720s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 Jul 23 03:34:44 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935" returned: 0 in 0.314s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Attempting download of 25d0672f-71e9-439e-848d-b5cd5a256792 ((None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}])) to volume 956116ab-0d50-4f51-a909-6d60daec2935. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b7185-ccac-4a08-ada2-88c480487dd5]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d Jul 23 03:34:44 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:45 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d" returned: 0 in 0.457s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:45 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d Jul 23 03:34:45 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:45 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d" returned: 1 in 0.648s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d0672f-71e9-439e-848d-b5cd5a256792_zn8oeh9d' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a2c9a-d093-41e9-b2ca-102987682d83]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:46 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD Jul 23 03:34:46 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] 25d0672f-71e9-439e-848d-b5cd5a256792 was raw, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:34:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 Jul 23 03:34:46 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:47 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935" returned: 0 in 0.580s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25d0672f-71e9-439e-848d-b5cd5a256792_n5dtpgtydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:34:47 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:47 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1G Jul 23 03:34:47 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:47 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 1G" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Downloaded image 25d0672f-71e9-439e-848d-b5cd5a256792 ((None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}])) to volume 956116ab-0d50-4f51-a909-6d60daec2935 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Temporary image 25d0672f-71e9-439e-848d-b5cd5a256792 for user c08e83f3f4554c4796dac0e9deb759e6 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Marking volume 956116ab-0d50-4f51-a909-6d60daec2935 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Copying metadata from image 25d0672f-71e9-439e-848d-b5cd5a256792 to 956116ab-0d50-4f51-a909-6d60daec2935. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Creating volume glance metadata for volume 956116ab-0d50-4f51-a909-6d60daec2935 backed by image 25d0672f-71e9-439e-848d-b5cd5a256792 with: {'image_id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '436000e6e3f6558e1e59021c47df272c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd02419-4089-4aad-8e04-46533b9185ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956116ab-0d50-4f51-a909-6d60daec2935', 'volume_size': 1, 'image_id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d0672f-71e9-439e-848d-b5cd5a256792', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436000e6e3f6558e1e59021c47df272c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a19e56089bf8407e98bd4a958ce061ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60806cd5bae27ee0871a8b987ae6cf1c7913308927010569fe4c184f3122e37316915900260101f0bb743930471841a46edf69d309048aaef63e38338a29e9e', 'id': '25d0672f-71e9-439e-848d-b5cd5a256792', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d0672f-71e9-439e-848d-b5cd5a256792/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b1f96b-e983-48c8-b448-cceb4faf75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Volume volume-956116ab-0d50-4f51-a909-6d60daec2935 (956116ab-0d50-4f51-a909-6d60daec2935): created successfully Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b1f96b-e983-48c8-b448-cceb4faf75eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Flow 'volume_create_manager' (3973e084-78ad-40d4-851e-09bae4a34fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-27e2d67f-f50d-4e7a-81ad-10530cdb82f1 tempest-VolumeImageDependencyTests-1313393400 None] Created volume successfully. Jul 23 03:34:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Acquiring lock "cinder-956116ab-0d50-4f51-a909-6d60daec2935-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "cinder-956116ab-0d50-4f51-a909-6d60daec2935-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Acquiring lock "cinder-quobyte-956116ab-0d50-4f51-a909-6d60daec2935" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "cinder-quobyte-956116ab-0d50-4f51-a909-6d60daec2935" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d0bb39-ded1-4aa3-8429-773fe9bbdc93]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:49 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 Jul 23 03:34:49 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:49 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935" returned: 0 in 0.882s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:50 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935 Jul 23 03:34:50 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:50 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-956116ab-0d50-4f51-a909-6d60daec2935" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "cinder-quobyte-956116ab-0d50-4f51-a909-6d60daec2935" released by "delete_volume" :: held 1.325s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Created reservations ['ed6bd31e-3cac-4360-8b44-65c9da17a50f', 'a15eea54-de31-468b-8dc4-35457876e4b4', 'c3ee9802-420c-4b4a-aba1-f12e435ebdd9', '9ac5e55b-5b7d-4d3f-ab74-28cc935812db'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:50 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:50 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:51 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.486s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:51 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Deleted volume successfully. Jul 23 03:34:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d9a398a6-e601-405b-9d25-bdb2de48513c tempest-VolumeImageDependencyTests-1313393400 None] Lock "cinder-956116ab-0d50-4f51-a909-6d60daec2935-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Flow 'volume_create_manager' (0f6706ba-38aa-4a9d-835d-c91aa33b0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d8019-636e-4fe6-80ec-32e16f92cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d8019-636e-4fe6-80ec-32e16f92cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062393176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b80fa9-da98-4f05-9ebb-595098ddace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff67d9d0ea4827830b3a89a6dc3f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:57Z,use_quota=True,user_id='92a32884f7654f17a518a09ff50242c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3759c4-52ec-4697-a761-08efd1591762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3759c4-52ec-4697-a761-08efd1591762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d3bdef-5391-4036-b728-ecc25918ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d3bdef-5391-4036-b728-ecc25918ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b80fa9-da98-4f05-9ebb-595098ddace7', 'volume_name': 'volume-d2b80fa9-da98-4f05-9ebb-595098ddace7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3873b08-7008-4fda-9c2a-01cc98f97343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3873b08-7008-4fda-9c2a-01cc98f97343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7257b26-73a3-49b3-b5d6-2c5b090c33bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Volume d2b80fa9-da98-4f05-9ebb-595098ddace7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b80fa9-da98-4f05-9ebb-595098ddace7', 'volume_size': 1} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062393176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b80fa9-da98-4f05-9ebb-595098ddace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff67d9d0ea4827830b3a89a6dc3f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:57Z,use_quota=True,user_id='92a32884f7654f17a518a09ff50242c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Creating volume d2b80fa9-da98-4f05-9ebb-595098ddace7 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:56 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:34:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:56 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 1073741824 Jul 23 03:34:56 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 1073741824" returned: 0 in 0.467s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 Jul 23 03:34:57 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7" returned: 0 in 0.291s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7257b26-73a3-49b3-b5d6-2c5b090c33bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b80fa9-da98-4f05-9ebb-595098ddace7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd26ad2d-3cf2-4084-a810-50af2fcf7077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:57 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Volume volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 (d2b80fa9-da98-4f05-9ebb-595098ddace7): created successfully Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd26ad2d-3cf2-4084-a810-50af2fcf7077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Flow 'volume_create_manager' (0f6706ba-38aa-4a9d-835d-c91aa33b0d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6768a638-48ed-4f21-bb43-72e9cf45b6a1 tempest-ProjectReaderTests-235717868 None] Created volume successfully. Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "cinder-d2b80fa9-da98-4f05-9ebb-595098ddace7-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-d2b80fa9-da98-4f05-9ebb-595098ddace7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "cinder-quobyte-d2b80fa9-da98-4f05-9ebb-595098ddace7" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-quobyte-d2b80fa9-da98-4f05-9ebb-595098ddace7" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[96885ea5-8d0b-46b3-83cd-7028e6f43cfd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 Jul 23 03:34:59 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7 Jul 23 03:34:59 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d2b80fa9-da98-4f05-9ebb-595098ddace7" returned: 0 in 0.270s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-quobyte-d2b80fa9-da98-4f05-9ebb-595098ddace7" released by "delete_volume" :: held 0.706s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Created reservations ['60355534-7e27-411a-944b-daa2fd19bf1e', '143b1d2f-c9d4-4acd-bc32-90bbc7ffacd5', '1a819f51-c00a-4af8-bcf0-603d2b81e73a', 'ada9bf73-dd40-468c-81ff-f460ab9877b3'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:34:59 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Deleted volume successfully. Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ea8396f9-922d-403e-b44b-03e6c3d6a2b7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-d2b80fa9-da98-4f05-9ebb-595098ddace7-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Flow 'volume_create_manager' (ef895b9e-7ebb-4226-9fc3-02c3980bd653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad6445a-970a-4512-891d-89e41d5dc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad6445a-970a-4512-891d-89e41d5dc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591394472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda9cbd-20c3-4e7d-b94e-b533982c2b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff67d9d0ea4827830b3a89a6dc3f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:01Z,use_quota=True,user_id='92a32884f7654f17a518a09ff50242c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb22093b-d2b9-416e-80b1-34c9f0dedaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb22093b-d2b9-416e-80b1-34c9f0dedaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c49f83-58c5-400d-91a0-761119c36515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c49f83-58c5-400d-91a0-761119c36515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cda9cbd-20c3-4e7d-b94e-b533982c2b6d', 'volume_name': 'volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c686d6-de40-4413-a30b-ff46ef16d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c686d6-de40-4413-a30b-ff46ef16d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83a40f-ab85-437f-965c-9aaffaaa3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:00 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Volume 9cda9cbd-20c3-4e7d-b94e-b533982c2b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d', 'volume_size': 1} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591394472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda9cbd-20c3-4e7d-b94e-b533982c2b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff67d9d0ea4827830b3a89a6dc3f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:01Z,use_quota=True,user_id='92a32884f7654f17a518a09ff50242c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Creating volume 9cda9cbd-20c3-4e7d-b94e-b533982c2b6d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:00 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:35:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d 1073741824 Jul 23 03:35:00 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:01 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d 1073741824" returned: 0 in 0.482s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:01 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d Jul 23 03:35:01 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:01 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" returned: 0 in 0.266s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83a40f-ab85-437f-965c-9aaffaaa3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93e47ba-fb7b-4356-87ab-9fe2d68dc68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Volume volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d (9cda9cbd-20c3-4e7d-b94e-b533982c2b6d): created successfully Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93e47ba-fb7b-4356-87ab-9fe2d68dc68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Flow 'volume_create_manager' (ef895b9e-7ebb-4226-9fc3-02c3980bd653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:01 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8291c3ae-9989-4769-a972-c244f4852985 tempest-ProjectReaderTests-235717868 None] Created volume successfully. Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "cinder-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "cinder-quobyte-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-quobyte-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db15d3-1622-468e-acde-2f19c9cf5e20]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d Jul 23 03:35:03 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" returned: 0 in 0.390s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d Jul 23 03:35:03 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-quobyte-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d" released by "delete_volume" :: held 0.717s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Created reservations ['74f301cf-9a19-46e9-8b5e-21efb7bf9c8f', '665a06b2-2696-46ca-adc9-fadbb69b59e8', '111d995d-dc14-4ebb-be7f-619146d58f8d', 'e918dda6-2d18-4fdd-a9f7-40fe18a7fe59'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:35:03 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.291s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Deleted volume successfully. Jul 23 03:35:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-434be37c-97ef-4a3a-bb6c-b783c62128f7 tempest-ProjectReaderTests-235717868 None] Lock "cinder-9cda9cbd-20c3-4e7d-b94e-b533982c2b6d-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:13 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=65,cinder:INSERT=26,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:14 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=82,cinder:SELECT=59,cinder:INSERT=19,cinder:DELETE=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e5e9895d-6cb3-4088-885b-ac90218a87cb req-0b139d6a-1bb2-4ba7-b2a4-a1934d211962 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e5e9895d-6cb3-4088-885b-ac90218a87cb req-0b139d6a-1bb2-4ba7-b2a4-a1934d211962 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-e5e9895d-6cb3-4088-885b-ac90218a87cb req-0b139d6a-1bb2-4ba7-b2a4-a1934d211962 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e5e9895d-6cb3-4088-885b-ac90218a87cb req-0b139d6a-1bb2-4ba7-b2a4-a1934d211962 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc18485c-96d7-493c-8262-595cf9e27609', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:35:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e5e9895d-6cb3-4088-885b-ac90218a87cb req-0b139d6a-1bb2-4ba7-b2a4-a1934d211962 tempest-TestServerVolumeAttachmentScenario-1204076664 None] attachment_update completed successfully. Jul 23 03:35:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-d3394900-095b-47b0-b6b8-400580e0dafe req-78c0ec4b-18ea-40b6-a13b-c3f4824b7edf tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-d3394900-095b-47b0-b6b8-400580e0dafe req-78c0ec4b-18ea-40b6-a13b-c3f4824b7edf tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-d3394900-095b-47b0-b6b8-400580e0dafe req-78c0ec4b-18ea-40b6-a13b-c3f4824b7edf tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:20 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-d3394900-095b-47b0-b6b8-400580e0dafe req-78c0ec4b-18ea-40b6-a13b-c3f4824b7edf tempest-TestServerVolumeAttachmentScenario-1204076664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-57578b3e-1be4-4c60-bad5-53562c128a89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd4df6f6-2bff-4a5b-99fa-1c281facb39a', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:35:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-d3394900-095b-47b0-b6b8-400580e0dafe req-78c0ec4b-18ea-40b6-a13b-c3f4824b7edf tempest-TestServerVolumeAttachmentScenario-1204076664 None] attachment_update completed successfully. Jul 23 03:35:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-e89ac0e3-dad9-462a-bc2b-92d354dea46d req-cab6f227-41b3-4a38-afd0-477b181b399b tempest-TestServerVolumeAttachmentScenario-1204076664 None] Terminate volume connection completed successfully. Jul 23 03:35:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-e89ac0e3-dad9-462a-bc2b-92d354dea46d req-cab6f227-41b3-4a38-afd0-477b181b399b tempest-TestServerVolumeAttachmentScenario-1204076664 None] Deleting attachment fd4df6f6-2bff-4a5b-99fa-1c281facb39a. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:35:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-88534915-e5cc-4399-ab8e-ec1a57b8b45d req-b39ff612-5333-473d-b524-15080a6357f8 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Terminate volume connection completed successfully. Jul 23 03:35:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-88534915-e5cc-4399-ab8e-ec1a57b8b45d req-b39ff612-5333-473d-b524-15080a6357f8 tempest-TestServerVolumeAttachmentScenario-1204076664 None] Deleting attachment cc18485c-96d7-493c-8262-595cf9e27609. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "cinder-57578b3e-1be4-4c60-bad5-53562c128a89-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-57578b3e-1be4-4c60-bad5-53562c128a89-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "cinder-quobyte-57578b3e-1be4-4c60-bad5-53562c128a89" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-quobyte-57578b3e-1be4-4c60-bad5-53562c128a89" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[df575c6e-9592-4404-bfd0-864d3d2379c1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:28 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 Jul 23 03:35:28 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:28 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89" returned: 0 in 0.383s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:28 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89 Jul 23 03:35:28 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:29 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-57578b3e-1be4-4c60-bad5-53562c128a89" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-quobyte-57578b3e-1be4-4c60-bad5-53562c128a89" released by "delete_volume" :: held 0.697s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Created reservations ['5d6be481-1f44-42a7-a822-aeb677e068f9', '96bbdbd4-2d44-43c3-b987-c9e279cdba15', '3a4a08df-59a7-4bea-9a9c-250506b3ae79', '929f3ca2-d506-432d-9271-1fa2f95caffc'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:35:29 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "cinder-947cef36-7977-45a7-9eb6-84c3c29d0ccb-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:29 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Deleted volume successfully. Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-947cef36-7977-45a7-9eb6-84c3c29d0ccb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-15d5f5dd-c1cd-4723-93f3-65bbb626656e tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-57578b3e-1be4-4c60-bad5-53562c128a89-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "cinder-quobyte-947cef36-7977-45a7-9eb6-84c3c29d0ccb" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-quobyte-947cef36-7977-45a7-9eb6-84c3c29d0ccb" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[882ebc1c-c001-4f70-9eaa-eb851c132986]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb Jul 23 03:35:29 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:29 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb Jul 23 03:35:29 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:30 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-947cef36-7977-45a7-9eb6-84c3c29d0ccb" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-quobyte-947cef36-7977-45a7-9eb6-84c3c29d0ccb" released by "delete_volume" :: held 0.699s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Created reservations ['90b30584-ae63-463d-bef1-3fef55a21d77', 'bee87680-223f-45b5-9f9e-49c798500329', 'da532c6d-5723-4bb9-a4a5-2175af21dfa2', '7a09f622-2c86-4524-8c48-b4a94202769b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:30 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:35:30 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:30 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.267s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Deleted volume successfully. Jul 23 03:35:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5d952ada-21ce-4c84-91f6-49113261e29d tempest-TestServerVolumeAttachmentScenario-1204076664 None] Lock "cinder-947cef36-7977-45a7-9eb6-84c3c29d0ccb-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:35 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:35:35 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:36 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:35:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:35:40 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=5 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:40 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Flow 'volume_create_manager' (b719ffec-1a6c-47a6-9fd6-07d52281e4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4beb70-2366-4fa5-934e-409a10258cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4beb70-2366-4fa5-934e-409a10258cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759547708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a9f16e-01ac-4784-9a54-d18269a086d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38dff94142b4fdbaf627a1e2f1c921c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:05Z,use_quota=True,user_id='24cefdfe932742e8957f7cfa89d85c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b11aa8c-65b1-4c70-8ea8-ba625456a5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b11aa8c-65b1-4c70-8ea8-ba625456a5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88de4146-5a89-45de-b7aa-97193d3a90f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:04 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88de4146-5a89-45de-b7aa-97193d3a90f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06a9f16e-01ac-4784-9a54-d18269a086d6', 'volume_name': 'volume-06a9f16e-01ac-4784-9a54-d18269a086d6', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e3dc02-3fdb-4767-9dcc-2f6d4fb5c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e3dc02-3fdb-4767-9dcc-2f6d4fb5c67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a310bc-75d4-4228-9474-b2d72463d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Volume 06a9f16e-01ac-4784-9a54-d18269a086d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06a9f16e-01ac-4784-9a54-d18269a086d6', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Trying to clone 06a9f16e-01ac-4784-9a54-d18269a086d6 from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 at location (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:36:05 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd25d5-6634-4793-951f-d7e27f20c1a9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:05 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD Jul 23 03:36:05 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:05 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 is fetched for user 24cefdfe932742e8957f7cfa89d85c97. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe24ae-d501-4c1f-98f3-4a9c08d32691]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD Jul 23 03:36:06 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759547708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a9f16e-01ac-4784-9a54-d18269a086d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38dff94142b4fdbaf627a1e2f1c921c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:05Z,use_quota=True,user_id='24cefdfe932742e8957f7cfa89d85c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Creating volume 06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:06 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1073741824 Jul 23 03:36:06 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1073741824" returned: 0 in 0.419s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 Jul 23 03:36:06 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6" returned: 0 in 0.248s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Attempting download of 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 06a9f16e-01ac-4784-9a54-d18269a086d6. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bdc849-e075-4286-9a8f-08b2f91cb3cd]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj Jul 23 03:36:07 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj Jul 23 03:36:07 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj" returned: 1 in 0.359s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_305f1036-a296-4b7a-ad9a-5bff6ecc6243_apq0x7jj' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7db2b-b276-40cb-ab3c-d141ae3c1784]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD Jul 23 03:36:07 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:08 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:08 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] 305f1036-a296-4b7a-ad9a-5bff6ecc6243 was qcow2, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:36:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:08 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 Jul 23 03:36:08 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6" returned: 0 in 1.627s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_305f1036-a296-4b7a-ad9a-5bff6ecc6243_sjpvg79adevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:36:09 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Converted 112.00 MB image at 68.77 MB/s Jul 23 03:36:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1G Jul 23 03:36:09 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 1G" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Downloaded image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 ((None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}])) to volume 06a9f16e-01ac-4784-9a54-d18269a086d6 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Temporary image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 for user 24cefdfe932742e8957f7cfa89d85c97 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Marking volume 06a9f16e-01ac-4784-9a54-d18269a086d6 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Copying metadata from image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 to 06a9f16e-01ac-4784-9a54-d18269a086d6. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Creating volume glance metadata for volume 06a9f16e-01ac-4784-9a54-d18269a086d6 backed by image 305f1036-a296-4b7a-ad9a-5bff6ecc6243 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a310bc-75d4-4228-9474-b2d72463d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a9f16e-01ac-4784-9a54-d18269a086d6', 'volume_size': 1, 'image_id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db76de28c0554d47b80a705e52da729f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '305f1036-a296-4b7a-ad9a-5bff6ecc6243', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/305f1036-a296-4b7a-ad9a-5bff6ecc6243/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2ea49-0a17-4253-a588-35893ec13462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:10 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Volume volume-06a9f16e-01ac-4784-9a54-d18269a086d6 (06a9f16e-01ac-4784-9a54-d18269a086d6): created successfully Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2ea49-0a17-4253-a588-35893ec13462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:10 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Flow 'volume_create_manager' (b719ffec-1a6c-47a6-9fd6-07d52281e4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:10 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-532a2378-b8d7-4054-860c-a4a5004a88f2 tempest-TestShelveInstance-1470662989 None] Created volume successfully. Jul 23 03:36:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-31cf803d-65fe-4a79-b1c9-9bb662dc5e26 req-6447cbec-4d41-4c5e-9aa2-ac8475bd3bbe tempest-TestShelveInstance-1470662989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-31cf803d-65fe-4a79-b1c9-9bb662dc5e26 req-6447cbec-4d41-4c5e-9aa2-ac8475bd3bbe tempest-TestShelveInstance-1470662989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-31cf803d-65fe-4a79-b1c9-9bb662dc5e26 req-6447cbec-4d41-4c5e-9aa2-ac8475bd3bbe tempest-TestShelveInstance-1470662989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-31cf803d-65fe-4a79-b1c9-9bb662dc5e26 req-6447cbec-4d41-4c5e-9aa2-ac8475bd3bbe tempest-TestShelveInstance-1470662989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-06a9f16e-01ac-4784-9a54-d18269a086d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e406e774-23b5-4d3a-97ca-42f6bea75561', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:36:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-31cf803d-65fe-4a79-b1c9-9bb662dc5e26 req-6447cbec-4d41-4c5e-9aa2-ac8475bd3bbe tempest-TestShelveInstance-1470662989 None] attachment_update completed successfully. Jul 23 03:36:23 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=5 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:35 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:36:35 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:36 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.245s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:36:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:36:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-d605e7d7-5890-4c95-b8d3-f31331f365c9 req-da64c2bd-9ff7-4821-9539-fefbd27b2335 tempest-TestShelveInstance-1470662989 None] Terminate volume connection completed successfully. Jul 23 03:36:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-d605e7d7-5890-4c95-b8d3-f31331f365c9 req-da64c2bd-9ff7-4821-9539-fefbd27b2335 tempest-TestShelveInstance-1470662989 None] Deleting attachment e406e774-23b5-4d3a-97ca-42f6bea75561. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:36:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-f6ac7f46-20c7-4db4-b1a6-12eca4b91d1b req-e9586f20-f394-45e1-b0da-79bafd7590e9 tempest-TestShelveInstance-1470662989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-f6ac7f46-20c7-4db4-b1a6-12eca4b91d1b req-e9586f20-f394-45e1-b0da-79bafd7590e9 tempest-TestShelveInstance-1470662989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-f6ac7f46-20c7-4db4-b1a6-12eca4b91d1b req-e9586f20-f394-45e1-b0da-79bafd7590e9 tempest-TestShelveInstance-1470662989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-f6ac7f46-20c7-4db4-b1a6-12eca4b91d1b req-e9586f20-f394-45e1-b0da-79bafd7590e9 tempest-TestShelveInstance-1470662989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a', 'name': 'volume-06a9f16e-01ac-4784-9a54-d18269a086d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bb451a4-432b-4297-ad04-111c922beea5', 'enforce_multipath': True} {{(pid=88044) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:36:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-f6ac7f46-20c7-4db4-b1a6-12eca4b91d1b req-e9586f20-f394-45e1-b0da-79bafd7590e9 tempest-TestShelveInstance-1470662989 None] attachment_update completed successfully. Jul 23 03:36:57 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:57 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-3cb9e43f-bf2d-4d83-a18c-a1b5ce0f8604 tempest-TestShelveInstance-1470662989 None] Terminate volume connection completed successfully. Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-3cb9e43f-bf2d-4d83-a18c-a1b5ce0f8604 tempest-TestShelveInstance-1470662989 None] Deleting attachment 7bb451a4-432b-4297-ad04-111c922beea5. {{(pid=88044) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Acquiring lock "cinder-06a9f16e-01ac-4784-9a54-d18269a086d6-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "cinder-06a9f16e-01ac-4784-9a54-d18269a086d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Acquiring lock "cinder-quobyte-06a9f16e-01ac-4784-9a54-d18269a086d6" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "cinder-quobyte-06a9f16e-01ac-4784-9a54-d18269a086d6" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694f3c0-6892-452d-b741-4514f59aaaee]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:15 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 Jul 23 03:37:15 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6" returned: 0 in 0.405s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:16 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6 Jul 23 03:37:16 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-06a9f16e-01ac-4784-9a54-d18269a086d6" returned: 0 in 0.250s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "cinder-quobyte-06a9f16e-01ac-4784-9a54-d18269a086d6" released by "delete_volume" :: held 0.698s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.quota [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Created reservations ['c654c5f1-f765-4a6b-bd0f-08ea916926d8', '673d316f-d0a2-48b5-88ef-b084a404d109', 'fd445aaf-cffc-446b-bbfb-b67f097110ca', '7d230055-e49e-45d2-8aaf-9ff2d885b139'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:16 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:16 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.manager [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Deleted volume successfully. Jul 23 03:37:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [req-47ee2451-c0d2-4fd6-a8cc-b927fa311a9d req-da7925e6-e3f0-4a7e-a51c-f9814b1dbc70 tempest-TestShelveInstance-1470662989 None] Lock "cinder-06a9f16e-01ac-4784-9a54-d18269a086d6-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:26 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:26 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (f21b92b4-d520-4db8-9799-ac5b18c7f360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d59606-1bba-414a-bc65-d193ad035f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d59606-1bba-414a-bc65-d193ad035f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757737117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ba054d-3a46-4aaa-a60d-76dbc37d7a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:27Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aad833f-1a74-45e5-9d13-d74ee1d46ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aad833f-1a74-45e5-9d13-d74ee1d46ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3803fa92-0f9d-4e0c-9b98-be1d53efc37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3803fa92-0f9d-4e0c-9b98-be1d53efc37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ba054d-3a46-4aaa-a60d-76dbc37d7a0b', 'volume_name': 'volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac6342-61e0-466e-bf8d-88817762a03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac6342-61e0-466e-bf8d-88817762a03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4222a9c1-06ac-45a4-bf29-c7801e99891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Volume 84ba054d-3a46-4aaa-a60d-76dbc37d7a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b', 'volume_size': 1} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757737117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ba054d-3a46-4aaa-a60d-76dbc37d7a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:27Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Creating volume 84ba054d-3a46-4aaa-a60d-76dbc37d7a0b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:27 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:27 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b 1073741824 Jul 23 03:37:27 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (54f7c646-4a56-4792-a299-145e4e346b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d73b276-68ac-4745-9621-044d30e813cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d73b276-68ac-4745-9621-044d30e813cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272536670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6761762e-022c-4578-9f58-fcdd2580302f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74069c87-1d7e-4879-9d13-b507b9030821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74069c87-1d7e-4879-9d13-b507b9030821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585834b6-6afb-411d-a392-83a73c2a8c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585834b6-6afb-411d-a392-83a73c2a8c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6761762e-022c-4578-9f58-fcdd2580302f', 'volume_name': 'volume-6761762e-022c-4578-9f58-fcdd2580302f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e17d9b8-3c69-46f3-b4f7-d36816bd72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e17d9b8-3c69-46f3-b4f7-d36816bd72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f183c8f7-b34b-411b-9147-e48f83c61a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Volume 6761762e-022c-4578-9f58-fcdd2580302f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6761762e-022c-4578-9f58-fcdd2580302f', 'volume_size': 1} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:27 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b 1073741824" returned: 0 in 0.519s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:28 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b Jul 23 03:37:28 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (70f44f01-d7b4-453f-8980-9602cb288722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fb0973-4390-4201-97eb-9250d0eaafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fb0973-4390-4201-97eb-9250d0eaafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233744576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677059c8-2b5d-484f-9716-602f36e61933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03a4647-f5d0-4465-aed6-571199cb262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03a4647-f5d0-4465-aed6-571199cb262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ed6586-f66d-4bca-b407-0d55010298cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ed6586-f66d-4bca-b407-0d55010298cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677059c8-2b5d-484f-9716-602f36e61933', 'volume_name': 'volume-677059c8-2b5d-484f-9716-602f36e61933', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe80338-fadd-46af-8110-a18e511a86fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe80338-fadd-46af-8110-a18e511a86fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee5ac18-aacb-46e4-8378-3692112eff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Volume 677059c8-2b5d-484f-9716-602f36e61933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677059c8-2b5d-484f-9716-602f36e61933', 'volume_size': 1} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" returned: 0 in 0.292s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272536670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6761762e-022c-4578-9f58-fcdd2580302f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Creating volume 6761762e-022c-4578-9f58-fcdd2580302f {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4222a9c1-06ac-45a4-bf29-c7801e99891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e072ac-1d16-45ce-aa32-40b7a266bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f 1073741824 Jul 23 03:37:28 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Volume volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b (84ba054d-3a46-4aaa-a60d-76dbc37d7a0b): created successfully Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e072ac-1d16-45ce-aa32-40b7a266bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (f21b92b4-d520-4db8-9799-ac5b18c7f360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6ff62511-9ed1-4459-bc2d-f45609569eef tempest-CreateVolumesFromImageTest-579757672 None] Created volume successfully. Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (b35b4a3e-c583-47fb-9742-6e9533780e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b9667-b695-46bf-96c4-3f429d6e8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b9667-b695-46bf-96c4-3f429d6e8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353489710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5f18d-c339-4eb8-bcd0-e822dabbb268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a59868-1857-4d85-9bfd-75cbcf3553b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a59868-1857-4d85-9bfd-75cbcf3553b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b73e0-b877-46e2-8a53-05904bba8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b73e0-b877-46e2-8a53-05904bba8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b5f18d-c339-4eb8-bcd0-e822dabbb268', 'volume_name': 'volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c13a1bc-e33b-4186-a290-bad146831e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c13a1bc-e33b-4186-a290-bad146831e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273f84d-d695-43cb-b9b4-fac307fb4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Volume 98b5f18d-c339-4eb8-bcd0-e822dabbb268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268', 'volume_size': 1} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f 1073741824" returned: 0 in 0.480s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (3816908e-7713-4913-8d3f-9b9726ab1891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bed8f5e-52d2-4968-8159-823465bec0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bed8f5e-52d2-4968-8159-823465bec0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088511951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6104c05a-9230-4a62-a855-1cab2e57137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:29Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8b21be-9005-4dd7-94a7-be537076cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8b21be-9005-4dd7-94a7-be537076cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87721377-ffef-4277-b844-80fb4c5b5e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87721377-ffef-4277-b844-80fb4c5b5e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6104c05a-9230-4a62-a855-1cab2e57137e', 'volume_name': 'volume-6104c05a-9230-4a62-a855-1cab2e57137e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af23c16-79fa-403b-8b89-feaf1c052155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af23c16-79fa-403b-8b89-feaf1c052155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b237ead7-7deb-498a-b029-06cce6bd8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Volume 6104c05a-9230-4a62-a855-1cab2e57137e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6104c05a-9230-4a62-a855-1cab2e57137e', 'volume_size': 1} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:28 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f Jul 23 03:37:28 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:29 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233744576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677059c8-2b5d-484f-9716-602f36e61933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Creating volume 677059c8-2b5d-484f-9716-602f36e61933 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f183c8f7-b34b-411b-9147-e48f83c61a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6761762e-022c-4578-9f58-fcdd2580302f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 1073741824 Jul 23 03:37:29 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80459c94-76d9-4a39-b069-27eabf430d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Volume volume-6761762e-022c-4578-9f58-fcdd2580302f (6761762e-022c-4578-9f58-fcdd2580302f): created successfully Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80459c94-76d9-4a39-b069-27eabf430d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (54f7c646-4a56-4792-a299-145e4e346b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f1a10a7c-cf33-40db-aadb-9a99f148b555 tempest-CreateVolumesFromImageTest-579757672 None] Created volume successfully. Jul 23 03:37:29 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 1073741824" returned: 0 in 0.437s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:29 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 Jul 23 03:37:29 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:29 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353489710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5f18d-c339-4eb8-bcd0-e822dabbb268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Creating volume 98b5f18d-c339-4eb8-bcd0-e822dabbb268 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:29 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 1073741824 Jul 23 03:37:29 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee5ac18-aacb-46e4-8378-3692112eff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677059c8-2b5d-484f-9716-602f36e61933', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dfac4f-6ace-49fa-923b-ec83f12ca3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Volume volume-677059c8-2b5d-484f-9716-602f36e61933 (677059c8-2b5d-484f-9716-602f36e61933): created successfully Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dfac4f-6ace-49fa-923b-ec83f12ca3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (70f44f01-d7b4-453f-8980-9602cb288722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-10e94f82-8eef-4f79-9c14-d271b0d572b6 tempest-CreateVolumesFromImageTest-579757672 None] Created volume successfully. Jul 23 03:37:30 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 1073741824" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:30 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 Jul 23 03:37:30 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:30 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088511951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6104c05a-9230-4a62-a855-1cab2e57137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c4fd0a6204413c9c36a1e4c692fbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:29Z,use_quota=True,user_id='d221a4c602104831b3a8e2fe82626668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Creating volume 6104c05a-9230-4a62-a855-1cab2e57137e {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:30 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:30 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e 1073741824 Jul 23 03:37:30 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273f84d-d695-43cb-b9b4-fac307fb4e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5908dde8-aeb1-4620-9474-fa1c66e2a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:30 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Volume volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 (98b5f18d-c339-4eb8-bcd0-e822dabbb268): created successfully Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5908dde8-aeb1-4620-9474-fa1c66e2a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:30 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (b35b4a3e-c583-47fb-9742-6e9533780e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:30 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4ceed59f-9c90-4f23-850a-65b867af311e tempest-CreateVolumesFromImageTest-579757672 None] Created volume successfully. Jul 23 03:37:31 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e 1073741824" returned: 0 in 0.441s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:31 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e Jul 23 03:37:31 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:31 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e" returned: 0 in 0.241s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b237ead7-7deb-498a-b029-06cce6bd8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6104c05a-9230-4a62-a855-1cab2e57137e', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00021111-e170-4754-ba63-4caeb7648b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:31 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Volume volume-6104c05a-9230-4a62-a855-1cab2e57137e (6104c05a-9230-4a62-a855-1cab2e57137e): created successfully Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00021111-e170-4754-ba63-4caeb7648b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:31 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Flow 'volume_create_manager' (3816908e-7713-4913-8d3f-9b9726ab1891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:31 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9a5405e8-a306-4d66-8fc5-c7376402e54e tempest-CreateVolumesFromImageTest-579757672 None] Created volume successfully. Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-6104c05a-9230-4a62-a855-1cab2e57137e-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-6104c05a-9230-4a62-a855-1cab2e57137e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-quobyte-6104c05a-9230-4a62-a855-1cab2e57137e" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-6104c05a-9230-4a62-a855-1cab2e57137e" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[07361938-a507-4838-9bd4-034337c8ae15]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:32 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e Jul 23 03:37:32 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:32 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:32 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e Jul 23 03:37:32 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:32 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6104c05a-9230-4a62-a855-1cab2e57137e" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-6104c05a-9230-4a62-a855-1cab2e57137e" released by "delete_volume" :: held 0.641s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:32 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Created reservations ['1ac58253-7614-4d48-9ca1-0e9638155044', '202f65df-2f80-4bcc-b906-645b66e52fa7', '420e755e-58c4-4ab1-ae97-73962ab0362f', 'b0cf37da-9a3c-45b9-bc37-2b3a2724539a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:33 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:33 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.244s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:33 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Deleted volume successfully. Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4f7d0c55-7d31-40ff-943d-b66ef3bfb2bd tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-6104c05a-9230-4a62-a855-1cab2e57137e-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-98b5f18d-c339-4eb8-bcd0-e822dabbb268-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-98b5f18d-c339-4eb8-bcd0-e822dabbb268-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-quobyte-98b5f18d-c339-4eb8-bcd0-e822dabbb268" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-98b5f18d-c339-4eb8-bcd0-e822dabbb268" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c408c88-39b1-4f92-aff5-8fd1850fb771]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 Jul 23 03:37:33 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:33 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268" returned: 0 in 0.365s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268 Jul 23 03:37:33 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:34 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-98b5f18d-c339-4eb8-bcd0-e822dabbb268" returned: 0 in 0.243s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-98b5f18d-c339-4eb8-bcd0-e822dabbb268" released by "delete_volume" :: held 0.646s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Created reservations ['76436891-bdac-4530-9a6f-d7262ec525da', 'd46b800e-1955-4d21-9805-c6eae6245310', '978d6883-10f9-4838-8295-ee8eab2106b0', 'e5fe9a2f-a404-4f15-9185-41bfbb66927e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:34 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:34 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:34 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Deleted volume successfully. Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-64f02a56-a199-4d45-9bb4-9445b7d9a9b8 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-98b5f18d-c339-4eb8-bcd0-e822dabbb268-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-677059c8-2b5d-484f-9716-602f36e61933-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-677059c8-2b5d-484f-9716-602f36e61933-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-quobyte-677059c8-2b5d-484f-9716-602f36e61933" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-677059c8-2b5d-484f-9716-602f36e61933" acquired by "delete_volume" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689587d-5126-4898-9865-f6c7e18da230]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:34 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 Jul 23 03:37:34 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:34 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933" returned: 0 in 0.362s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933 Jul 23 03:37:35 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:35 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-677059c8-2b5d-484f-9716-602f36e61933" returned: 0 in 0.244s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-677059c8-2b5d-484f-9716-602f36e61933" released by "delete_volume" :: held 0.643s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Created reservations ['c48a7edd-0237-407e-8900-ac20121a1f80', 'cec78108-ce8b-4ff0-80a6-13f56ff3fa09', 'a77257a4-0082-49f5-a801-18b12de1b226', '2328aa9d-66a9-45b9-9b55-31ebeb3cd09f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:35 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:35 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Deleted volume successfully. Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c5f3d5ee-d554-40b9-8061-df306cc95d77 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-677059c8-2b5d-484f-9716-602f36e61933-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-6761762e-022c-4578-9f58-fcdd2580302f-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-6761762e-022c-4578-9f58-fcdd2580302f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-quobyte-6761762e-022c-4578-9f58-fcdd2580302f" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-6761762e-022c-4578-9f58-fcdd2580302f" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd058c-3aaf-4be1-a079-9fdd82599029]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:35 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:35 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f Jul 23 03:37:35 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:36 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.288s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:37:36 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f" returned: 0 in 0.409s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:36 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f Jul 23 03:37:36 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:36 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-6761762e-022c-4578-9f58-fcdd2580302f" returned: 0 in 0.254s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-6761762e-022c-4578-9f58-fcdd2580302f" released by "delete_volume" :: held 0.703s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Created reservations ['a8c9743b-2ac4-41e9-8de2-b08ae3ede07b', 'bb5a5446-289b-4510-b8fa-02ef1040f55b', '6c654635-62f7-4a52-b8ec-5cadeba04c45', '704e5764-cf8c-4905-8a4b-15d489290f83'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:36 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:36 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:36 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Deleted volume successfully. Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b8231730-b2da-49a5-a9cd-97c5f639b448 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-6761762e-022c-4578-9f58-fcdd2580302f-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "cinder-quobyte-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1958f452-6c41-42da-b101-b3978f81fdd8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:37 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b Jul 23 03:37:37 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:37 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:37 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b Jul 23 03:37:37 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:37 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" returned: 0 in 0.254s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-quobyte-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b" released by "delete_volume" :: held 0.664s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Created reservations ['c53897ce-e387-4cd3-9778-6a059655c38d', '58198adf-1e2b-4de1-8999-2badeffd5d73', 'ee280d09-e42a-4c9a-a10c-0b052ba7cbda', '5a383438-38a2-4f3f-9a3e-a3f4f7d022fd'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:37 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:37 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:38 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.269s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:38 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Deleted volume successfully. Jul 23 03:37:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0f98a6fe-098c-4cb7-bce6-fc3971e4a4c0 tempest-CreateVolumesFromImageTest-579757672 None] Lock "cinder-84ba054d-3a46-4aaa-a60d-76dbc37d7a0b-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (388c4dad-f28d-40f2-b743-23a05bbe3f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ed37cf-1607-4f85-9435-b5433953e357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ed37cf-1607-4f85-9435-b5433953e357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638282171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32211401-cb6d-43f7-8781-39046599bc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:45Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1834f54-a485-4104-949f-49e88adce588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1834f54-a485-4104-949f-49e88adce588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d7e452-059d-472f-85c7-4b1e1bc35f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d7e452-059d-472f-85c7-4b1e1bc35f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32211401-cb6d-43f7-8781-39046599bc68', 'volume_name': 'volume-32211401-cb6d-43f7-8781-39046599bc68', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4c2841-139f-44d7-9162-19859fe98607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4c2841-139f-44d7-9162-19859fe98607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08466656-3175-460c-95ab-6d661b686143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Volume 32211401-cb6d-43f7-8781-39046599bc68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32211401-cb6d-43f7-8781-39046599bc68', 'volume_size': 1} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638282171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32211401-cb6d-43f7-8781-39046599bc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:45Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Creating volume 32211401-cb6d-43f7-8781-39046599bc68 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:45 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:45 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 1073741824 Jul 23 03:37:45 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:45 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 1073741824" returned: 0 in 0.412s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:45 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 Jul 23 03:37:45 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:46 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68" returned: 0 in 0.239s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08466656-3175-460c-95ab-6d661b686143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32211401-cb6d-43f7-8781-39046599bc68', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f6a6ca-4ba1-4549-b7b8-e07b5dfa4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Volume volume-32211401-cb6d-43f7-8781-39046599bc68 (32211401-cb6d-43f7-8781-39046599bc68): created successfully Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f6a6ca-4ba1-4549-b7b8-e07b5dfa4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (388c4dad-f28d-40f2-b743-23a05bbe3f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f1a71a09-b405-44b0-85ff-0f437963c875 tempest-ProjectReaderTests-2069389148 None] Created volume successfully. Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-32211401-cb6d-43f7-8781-39046599bc68-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-32211401-cb6d-43f7-8781-39046599bc68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-quobyte-32211401-cb6d-43f7-8781-39046599bc68" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-32211401-cb6d-43f7-8781-39046599bc68" acquired by "delete_volume" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd87d145-3968-4d1b-84e6-9d0192645f06]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:46 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 Jul 23 03:37:46 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:47 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:47 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68 Jul 23 03:37:47 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:47 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-32211401-cb6d-43f7-8781-39046599bc68" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-32211401-cb6d-43f7-8781-39046599bc68" released by "delete_volume" :: held 0.644s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Created reservations ['3d296ca4-edea-418f-b180-7812c39802fd', 'a3c828ef-b703-4e41-a4a2-49feb808823c', '129ad7fa-b0e2-41a5-8998-d747aed0d676', '42d3f0ad-cdde-454b-876e-0e21c340b32c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:47 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:47 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:47 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Deleted volume successfully. Jul 23 03:37:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9b04b82c-7f48-4af7-a01c-85d8066b6a57 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-32211401-cb6d-43f7-8781-39046599bc68-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (42750503-6a45-440d-8493-530430a04ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6829bdc-27dc-4896-b02a-b68120582601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6829bdc-27dc-4896-b02a-b68120582601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181804661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba09f27f-9ac8-421c-9cdd-e0772498efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:48Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a2ef10-ab02-4e90-b58a-9f8298b6fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a2ef10-ab02-4e90-b58a-9f8298b6fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec32aa0-d05c-465e-93b5-06f5e964549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec32aa0-d05c-465e-93b5-06f5e964549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba09f27f-9ac8-421c-9cdd-e0772498efea', 'volume_name': 'volume-ba09f27f-9ac8-421c-9cdd-e0772498efea', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d7951-7174-4bf1-b043-1ca5813d2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d7951-7174-4bf1-b043-1ca5813d2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055eb13a-87b3-48bc-be9f-0acda0519aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Volume ba09f27f-9ac8-421c-9cdd-e0772498efea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba09f27f-9ac8-421c-9cdd-e0772498efea', 'volume_size': 1} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181804661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba09f27f-9ac8-421c-9cdd-e0772498efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:48Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Creating volume ba09f27f-9ac8-421c-9cdd-e0772498efea {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:48 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:48 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea 1073741824 Jul 23 03:37:48 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:48 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea 1073741824" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:48 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea Jul 23 03:37:48 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:48 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea" returned: 0 in 0.255s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055eb13a-87b3-48bc-be9f-0acda0519aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba09f27f-9ac8-421c-9cdd-e0772498efea', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8718953e-eba8-402f-9e99-b10bacc55b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Volume volume-ba09f27f-9ac8-421c-9cdd-e0772498efea (ba09f27f-9ac8-421c-9cdd-e0772498efea): created successfully Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8718953e-eba8-402f-9e99-b10bacc55b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (42750503-6a45-440d-8493-530430a04ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1c5daac1-ebaa-44c9-981f-1213165e4cf9 tempest-ProjectReaderTests-2069389148 None] Created volume successfully. Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-ba09f27f-9ac8-421c-9cdd-e0772498efea-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "cinder-ba09f27f-9ac8-421c-9cdd-e0772498efea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-quobyte-ba09f27f-9ac8-421c-9cdd-e0772498efea" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-ba09f27f-9ac8-421c-9cdd-e0772498efea" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdf274d-93e9-48bc-bd43-3c9ae2bed96f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:49 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea Jul 23 03:37:49 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:49 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea" returned: 0 in 0.352s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:49 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea Jul 23 03:37:49 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:49 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ba09f27f-9ac8-421c-9cdd-e0772498efea" returned: 0 in 0.240s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-ba09f27f-9ac8-421c-9cdd-e0772498efea" released by "delete_volume" :: held 0.634s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:49 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Created reservations ['72a001dc-a496-4584-a623-367e85e04684', 'dfea743e-a5e1-4361-b6c7-4f1615a98ab1', '98f82c6f-e51d-4a77-a618-9182c2074545', 'e09ba037-33dd-4e73-acbb-45138118af09'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:50 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:50 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.257s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Deleted volume successfully. Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-50d0234f-d5a6-4a39-893c-75cab34e5b3e tempest-ProjectReaderTests-2069389148 None] Lock "cinder-ba09f27f-9ac8-421c-9cdd-e0772498efea-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (498b8fd6-d5c8-4cbd-af2f-c8a053238466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b2a314-9e16-4839-ba1e-0fab42b29c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b2a314-9e16-4839-ba1e-0fab42b29c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843460568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347680fa-3a03-4eeb-b21a-35b2b3546b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:51Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f9dd52-6251-48d0-9d44-5a56a47e1f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f9dd52-6251-48d0-9d44-5a56a47e1f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8712f3-5108-4e9b-bfdd-c1b0319226c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8712f3-5108-4e9b-bfdd-c1b0319226c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347680fa-3a03-4eeb-b21a-35b2b3546b54', 'volume_name': 'volume-347680fa-3a03-4eeb-b21a-35b2b3546b54', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3414ffe-14ec-4f6d-b483-37198b969ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3414ffe-14ec-4f6d-b483-37198b969ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2290ed23-fff3-4bd0-96a5-7842264dade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Volume 347680fa-3a03-4eeb-b21a-35b2b3546b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347680fa-3a03-4eeb-b21a-35b2b3546b54', 'volume_size': 1} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843460568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347680fa-3a03-4eeb-b21a-35b2b3546b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:51Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Creating volume 347680fa-3a03-4eeb-b21a-35b2b3546b54 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:50 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 1073741824 Jul 23 03:37:50 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 1073741824" returned: 0 in 0.399s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 Jul 23 03:37:51 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54" returned: 0 in 0.249s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2290ed23-fff3-4bd0-96a5-7842264dade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347680fa-3a03-4eeb-b21a-35b2b3546b54', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70208dd9-a3c2-432d-b2c6-debbad1c066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Volume volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 (347680fa-3a03-4eeb-b21a-35b2b3546b54): created successfully Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70208dd9-a3c2-432d-b2c6-debbad1c066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (498b8fd6-d5c8-4cbd-af2f-c8a053238466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-67673d22-45d9-4247-b1c3-1d55780e959e tempest-ProjectReaderTests-2069389148 None] Created volume successfully. Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-347680fa-3a03-4eeb-b21a-35b2b3546b54-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-347680fa-3a03-4eeb-b21a-35b2b3546b54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-quobyte-347680fa-3a03-4eeb-b21a-35b2b3546b54" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-347680fa-3a03-4eeb-b21a-35b2b3546b54" acquired by "delete_volume" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571d1a5-8d57-4ac6-9da5-8830dd4e8b36]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 Jul 23 03:37:52 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54 Jul 23 03:37:52 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-347680fa-3a03-4eeb-b21a-35b2b3546b54" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-347680fa-3a03-4eeb-b21a-35b2b3546b54" released by "delete_volume" :: held 0.659s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Created reservations ['79bfa762-9667-4ab2-b521-1cba46cc952b', 'd668b839-18a4-4be3-80b4-20b81fc4c9a9', '4a861bfc-1394-4c2a-bcaa-3ea58ad17b76', '576fb52f-353b-461d-bcb2-292920420172'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:52 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.242s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Deleted volume successfully. Jul 23 03:37:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3bfa5ed-03a9-46f3-97ca-515615358ba7 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-347680fa-3a03-4eeb-b21a-35b2b3546b54-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (4e2f7385-2c7c-497d-b615-200bf6c20710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4854079-dbec-4e5c-b74f-b6ccbe5260e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4854079-dbec-4e5c-b74f-b6ccbe5260e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361227369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b7a3d-3bfd-451f-8085-92ad9bacd736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:53Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6768700-aba5-4c69-a256-1bb05f87b734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6768700-aba5-4c69-a256-1bb05f87b734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b45b51-c320-46e8-aa19-cfb02cecc0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b45b51-c320-46e8-aa19-cfb02cecc0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9b7a3d-3bfd-451f-8085-92ad9bacd736', 'volume_name': 'volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7f13a-4963-4883-9317-8a48f8d73a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7f13a-4963-4883-9317-8a48f8d73a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2f7eb3-aace-4f53-a40a-c7bb6465f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:53 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Volume 9c9b7a3d-3bfd-451f-8085-92ad9bacd736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736', 'volume_size': 1} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361227369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b7a3d-3bfd-451f-8085-92ad9bacd736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4285fe51916448f3a466e99801ee1bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:53Z,use_quota=True,user_id='d8363036f5a94dc88d32e841090c51ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Creating volume 9c9b7a3d-3bfd-451f-8085-92ad9bacd736 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 1073741824 Jul 23 03:37:53 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 1073741824" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:54 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 Jul 23 03:37:54 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:54 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2f7eb3-aace-4f53-a40a-c7bb6465f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985fa3fa-281c-43ad-af3e-e87b2795da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Volume volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 (9c9b7a3d-3bfd-451f-8085-92ad9bacd736): created successfully Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985fa3fa-281c-43ad-af3e-e87b2795da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Flow 'volume_create_manager' (4e2f7385-2c7c-497d-b615-200bf6c20710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-608e7c27-6092-43f5-afe6-36573ebbddf4 tempest-ProjectReaderTests-2069389148 None] Created volume successfully. Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-9c9b7a3d-3bfd-451f-8085-92ad9bacd736-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-9c9b7a3d-3bfd-451f-8085-92ad9bacd736-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "cinder-quobyte-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29504ff-907c-4f80-abc5-b2b7f0736676]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:54 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 Jul 23 03:37:54 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:54 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" returned: 0 in 0.360s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:54 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736 Jul 23 03:37:54 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:55 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" returned: 0 in 0.250s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-quobyte-9c9b7a3d-3bfd-451f-8085-92ad9bacd736" released by "delete_volume" :: held 0.649s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Created reservations ['e749c6d4-d986-4f4e-8bab-b713a0735918', '9ece6f88-b300-4381-896d-36319b1c0806', '6d9bf03d-e25f-4718-ba2a-56e4988998b0', '20ccb9c6-80d6-4ad5-acb2-2fb434580863'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:55 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:37:55 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:55 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Deleted volume successfully. Jul 23 03:37:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-df133501-7b69-4762-b84d-1ad4e2908049 tempest-ProjectReaderTests-2069389148 None] Lock "cinder-9c9b7a3d-3bfd-451f-8085-92ad9bacd736-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=56,cinder:UPDATE=110,cinder:INSERT=24,cinder:DELETE=8 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:38:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=70,cinder:UPDATE=88,cinder:INSERT=21,cinder:DELETE=10 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Flow 'volume_create_manager' (2eccea68-eb59-4b33-9232-e5c95d5eb1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9c745d-ddec-4758-b13a-14cffb44c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9c745d-ddec-4758-b13a-14cffb44c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-204112700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0864db5c-fa61-477d-b09f-83db8cfdc6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71c555c372c4f91a76331ea62b49f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='f66a6b67bf7d4a50ad9fbde722f7eec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5abd00-4916-4347-a05d-e4c1a01a5081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5abd00-4916-4347-a05d-e4c1a01a5081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2dbd83-0938-4a50-b0ce-07bbf41d8b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2dbd83-0938-4a50-b0ce-07bbf41d8b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0864db5c-fa61-477d-b09f-83db8cfdc6d1', 'volume_name': 'volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08c8235-406d-46be-901f-3433b0105754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08c8235-406d-46be-901f-3433b0105754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efba2b5-e633-4809-9d06-150e66b7df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Volume 0864db5c-fa61-477d-b09f-83db8cfdc6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1', 'volume_size': 1} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-204112700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0864db5c-fa61-477d-b09f-83db8cfdc6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71c555c372c4f91a76331ea62b49f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='f66a6b67bf7d4a50ad9fbde722f7eec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Creating volume 0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:07 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:07 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 1073741824 Jul 23 03:38:07 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (f48600d6-6bb0-4765-a168-ba14239f41b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9202ed38-1fe3-4561-ba22-6daf14944091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9202ed38-1fe3-4561-ba22-6daf14944091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136916469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223b548-b772-4e2d-8f4b-e299bc74ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09811382-ae0c-4537-b7fc-7c81cd323098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09811382-ae0c-4537-b7fc-7c81cd323098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8918-cde1-4b19-8b9b-5ae8379b339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8918-cde1-4b19-8b9b-5ae8379b339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3223b548-b772-4e2d-8f4b-e299bc74ec32', 'volume_name': 'volume-3223b548-b772-4e2d-8f4b-e299bc74ec32', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a498bd13-f9e6-4d48-86cd-7192416f2fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a498bd13-f9e6-4d48-86cd-7192416f2fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a91618-ee3c-4cc3-9c6d-5b1e0579250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume 3223b548-b772-4e2d-8f4b-e299bc74ec32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3223b548-b772-4e2d-8f4b-e299bc74ec32', 'volume_size': 1} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:08 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 1073741824" returned: 0 in 0.592s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-016a573d-a700-43b4-bfa0-aafe816a6459 tempest-ProjectAdminTests-55631036 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88044) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:38:08 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:08 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:08 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.267s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136916469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223b548-b772-4e2d-8f4b-e299bc74ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume 3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:08 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:08 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 1073741824 Jul 23 03:38:08 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efba2b5-e633-4809-9d06-150e66b7df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7ea609-5eb7-475f-ba01-4bcbd587c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Volume volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 (0864db5c-fa61-477d-b09f-83db8cfdc6d1): created successfully Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7ea609-5eb7-475f-ba01-4bcbd587c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Flow 'volume_create_manager' (2eccea68-eb59-4b33-9232-e5c95d5eb1ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8945d67b-23b1-4a21-aadc-978c7e6ff0bf tempest-VolumeDependencyTests-712625145 None] Created volume successfully. Jul 23 03:38:09 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 1073741824" returned: 0 in 0.561s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:09 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 Jul 23 03:38:09 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:09 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a91618-ee3c-4cc3-9c6d-5b1e0579250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3223b548-b772-4e2d-8f4b-e299bc74ec32', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7da3049-d0c7-4c10-8e87-255a58bb98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:09 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 (3223b548-b772-4e2d-8f4b-e299bc74ec32): created successfully Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7da3049-d0c7-4c10-8e87-255a58bb98b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:09 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (f48600d6-6bb0-4765-a168-ba14239f41b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b0b27279-9eef-4531-89a6-ac53cd0f0f6f tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Creating offline snapshot 290d70df-d87f-4e91-8fcc-8c408d5902ce of volume 0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3f5087-7521-4fdd-9cec-162f859f965d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:10 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:10 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:10 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.446s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:10 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce 1G Jul 23 03:38:10 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce 1G" returned: 0 in 0.467s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:11 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce is being set with open permissions: ugo+rw Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:11 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info Jul 23 03:38:11 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:12 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info" returned: 0 in 0.284s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:12 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info is being set with open permissions: ugo+rw Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:12 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info Jul 23 03:38:12 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:12 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.info" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.117s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating offline snapshot ec8421d4-4aca-4299-9536-a096190136b9 of volume 3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:38:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-52f78aa7-51ac-454c-bfb3-015b882c5795 tempest-VolumeDependencyTests-712625145 None] Create snapshot completed successfully Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0edcee-849c-417d-9ea8-34b6592ca783]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Flow 'volume_create_manager' (b0a86cf7-52a0-4a99-a60e-47a5a1988b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706c16cd-3288-48c0-a8eb-0ed18f640c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706c16cd-3288-48c0-a8eb-0ed18f640c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc1c7d-c038-4865-8814-67ca58449f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6211535e1e844e2895bfbb306db8a17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:12Z,use_quota=True,user_id='cd142ee7f428425dba3b25f2863f3a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf5cd5bc-64ab-4f37-ab8b-11665c8fbaa7),volume_type_id=cf5cd5bc-64ab-4f37-ab8b-11665c8fbaa7)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5da8069-29be-4435-826c-e25b15d989b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5da8069-29be-4435-826c-e25b15d989b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:12 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 Jul 23 03:38:12 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4d165-2087-49c2-95d2-84044d88b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:38:12 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:12 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 1G Jul 23 03:38:12 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (eaab34ca-9741-479c-b338-4d3359ec4dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382f6276-ee12-4d7c-8702-f64dad498f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382f6276-ee12-4d7c-8702-f64dad498f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704564143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf3938b-e9ee-4dd6-8eca-acca7e2e9a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:13Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c346778e-2158-4ac9-a739-430107ba9b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c346778e-2158-4ac9-a739-430107ba9b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea660505-6e67-46d0-8871-8fb43709720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea660505-6e67-46d0-8871-8fb43709720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf3938b-e9ee-4dd6-8eca-acca7e2e9a86', 'volume_name': 'volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68061543-81b8-4a9c-a984-e29b89f51391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68061543-81b8-4a9c-a984-e29b89f51391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8176d9-3680-4777-901f-d80f69961d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Volume faf3938b-e9ee-4dd6-8eca-acca7e2e9a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86', 'volume_size': 1} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4d165-2087-49c2-95d2-84044d88b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1fc1c7d-c038-4865-8814-67ca58449f69', 'volume_name': 'volume-c1fc1c7d-c038-4865-8814-67ca58449f69', 'volume_size': 1, 'image_id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '912b62a79358b74a993936e7a097156b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6211535e1e844e2895bfbb306db8a17a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c919bc125dfb43de5be67385d03a5575450a7a138424d3822190f854eab7909fe75868aa278cedf9e6626db3386062375cc276431a574c05e1ba9d38ab73d9a1', 'id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8725a542-2a93-401e-be1f-6493a9e8d62a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d218d071-058f-4597-b58e-ffbaa3ef8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d218d071-058f-4597-b58e-ffbaa3ef8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32bc71-8047-4684-aa2f-acdc31cda793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Volume c1fc1c7d-c038-4865-8814-67ca58449f69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1fc1c7d-c038-4865-8814-67ca58449f69', 'volume_size': 1, 'image_id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '912b62a79358b74a993936e7a097156b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6211535e1e844e2895bfbb306db8a17a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c919bc125dfb43de5be67385d03a5575450a7a138424d3822190f854eab7909fe75868aa278cedf9e6626db3386062375cc276431a574c05e1ba9d38ab73d9a1', 'id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8725a542-2a93-401e-be1f-6493a9e8d62a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Trying to clone c1fc1c7d-c038-4865-8814-67ca58449f69 from image 8725a542-2a93-401e-be1f-6493a9e8d62a at location (None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:38:13 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc90a90-7820-452b-a5c3-91123fbbf124]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:13 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 1G" returned: 0 in 0.448s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:13 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 Jul 23 03:38:13 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:13 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:13 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:13 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9" returned: 0 in 0.341s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:13 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 is being set with open permissions: ugo+rw Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:13 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:13 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 Jul 23 03:38:13 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:13 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:13 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:14 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Flow 'volume_create_manager' (b041e453-c1c7-474e-ad99-e29dce6f642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0ef17-99cd-4a20-b972-2433c2620db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9" returned: 0 in 0.338s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0ef17-99cd-4a20-b972-2433c2620db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754154453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ad577a-864c-447f-a5a1-653305f10912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71c555c372c4f91a76331ea62b49f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=290d70df-d87f-4e91-8fcc-8c408d5902ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:14Z,use_quota=True,user_id='f66a6b67bf7d4a50ad9fbde722f7eec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70be9cda-07d9-4b95-b018-4a20145386c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70be9cda-07d9-4b95-b018-4a20145386c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb1e80-de45-47a3-8770-484b9b23718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb1e80-de45-47a3-8770-484b9b23718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4ad577a-864c-447f-a5a1-653305f10912', 'volume_name': 'volume-a4ad577a-864c-447f-a5a1-653305f10912', 'volume_size': 1, 'snapshot_id': '290d70df-d87f-4e91-8fcc-8c408d5902ce'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e84373b-203b-4df0-add4-983bdcba11af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e84373b-203b-4df0-add4-983bdcba11af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:14 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d975a755-6350-4d59-8257-c912856af155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Volume a4ad577a-864c-447f-a5a1-653305f10912: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4ad577a-864c-447f-a5a1-653305f10912', 'volume_size': 1, 'snapshot_id': '290d70df-d87f-4e91-8fcc-8c408d5902ce'} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Temporary image 8725a542-2a93-401e-be1f-6493a9e8d62a is fetched for user cd142ee7f428425dba3b25f2863f3a55. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info Jul 23 03:38:14 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a7489-adf8-4a42-a4ee-4ceef3be0918]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:14 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info" returned: 0 in 0.263s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info is being set with open permissions: ugo+rw Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info Jul 23 03:38:14 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:14 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.info" returned: 0 in 0.258s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704564143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf3938b-e9ee-4dd6-8eca-acca7e2e9a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:13Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Creating volume faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:14 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 1073741824 Jul 23 03:38:14 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-094714d4-3807-4f0f-af28-5eb00f5f7e1a tempest-CreateVolumesFromSnapshotTest-909219860 None] Create snapshot completed successfully Jul 23 03:38:14 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:15 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 1073741824" returned: 0 in 0.461s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:15 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 Jul 23 03:38:15 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:15 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" returned: 0 in 0.244s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.318s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce-a4ad577a-864c-447f-a5a1-653305f10912" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8176d9-3680-4777-901f-d80f69961d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4864c3e-ba45-4c55-9a1d-17ca4df6a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce-a4ad577a-864c-447f-a5a1-653305f10912" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Creating volume a4ad577a-864c-447f-a5a1-653305f10912 from snapshot 290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Volume volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 (faf3938b-e9ee-4dd6-8eca-acca7e2e9a86): created successfully Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4864c3e-ba45-4c55-9a1d-17ca4df6a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (eaab34ca-9741-479c-b338-4d3359ec4dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] snapshot: 290d70df-d87f-4e91-8fcc-8c408d5902ce, volume: a4ad577a-864c-447f-a5a1-653305f10912, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:38:15 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-172dd4be-8edc-43bf-bddf-caf78931ff52 tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62d570-10d6-4dd0-abb5-2ad8839d22f8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:15 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:15 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:15 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (b8249b52-908e-4e17-95ee-912b708ea61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bc1e78-ccb5-419b-ae77-d15cbfcf4b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.453s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bc1e78-ccb5-419b-ae77-d15cbfcf4b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040019054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b754b6e9-4a9c-4d83-9766-032c2ed355b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:16Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3969a32-382d-47d4-8eeb-2fffb6299b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3969a32-382d-47d4-8eeb-2fffb6299b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938149a8-cb23-4091-94cc-5ed7e3cc4775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938149a8-cb23-4091-94cc-5ed7e3cc4775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b754b6e9-4a9c-4d83-9766-032c2ed355b0', 'volume_name': 'volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edd31e0-075c-49ae-aa22-0753991af05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edd31e0-075c-49ae-aa22-0753991af05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011ee37c-367a-44ac-a43d-183a89531519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume b754b6e9-4a9c-4d83-9766-032c2ed355b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0', 'volume_size': 1} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe7f7e-d2f4-43e8-8ffe-6e62a0028db4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:16 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:16 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (bc1de4d3-998a-43d1-b72c-604b36c39b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0328fee0-e160-42e9-ae00-3da4cf6cf019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0328fee0-e160-42e9-ae00-3da4cf6cf019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61708926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29138a2-ed7a-4408-98de-f7267a6ec3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:16Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de93a6f1-0bf5-4836-b9d3-33634a7b1843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de93a6f1-0bf5-4836-b9d3-33634a7b1843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46252efd-ac6c-4ec1-b3a4-56681915ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46252efd-ac6c-4ec1-b3a4-56681915ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29138a2-ed7a-4408-98de-f7267a6ec3b1', 'volume_name': 'volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7522e39-a4aa-4ac1-aa29-77028ed7f24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7522e39-a4aa-4ac1-aa29-77028ed7f24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa66e4b8-5be4-4194-87bc-e39b9d997234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume d29138a2-ed7a-4408-98de-f7267a6ec3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1', 'volume_size': 1} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:16 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:16 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 Jul 23 03:38:16 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (43c9e65d-b7d4-497c-b6ce-ef305bd98634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc056b9f-5ab8-418a-b711-f87b83a95b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc056b9f-5ab8-418a-b711-f87b83a95b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935962484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba0f9db-d45e-486a-846b-34d7de0033a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:17Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a0990b-d18d-4d36-9626-561d3152ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a0990b-d18d-4d36-9626-561d3152ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b3038-a4af-474f-94ce-d1bb5c791253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b3038-a4af-474f-94ce-d1bb5c791253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba0f9db-d45e-486a-846b-34d7de0033a8', 'volume_name': 'volume-fba0f9db-d45e-486a-846b-34d7de0033a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e1bad8-d74f-48e8-a89a-c1f293ea5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e1bad8-d74f-48e8-a89a-c1f293ea5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d36325-a5ec-473c-a4b0-19242d0011d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume fba0f9db-d45e-486a-846b-34d7de0033a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba0f9db-d45e-486a-846b-34d7de0033a8', 'volume_size': 1} Jul 23 03:38:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (63991ac9-aa64-4a92-b7b2-ca2ce7465349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4e3778-038b-44e7-b1bf-cbe4e0c6244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4e3778-038b-44e7-b1bf-cbe4e0c6244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1017140197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb06bb0-c7c7-48e8-ae1e-439190d9c945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:17Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcef1b2-94b0-4154-bb74-ee2d2feceb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcef1b2-94b0-4154-bb74-ee2d2feceb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c9bbd9-bccf-4143-9c14-4bfd46721de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c9bbd9-bccf-4143-9c14-4bfd46721de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb06bb0-c7c7-48e8-ae1e-439190d9c945', 'volume_name': 'volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb93b87-311f-453b-9ab4-6e2c1fa9d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb93b87-311f-453b-9ab4-6e2c1fa9d737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0417e822-c72f-4e30-b45d-0d2098179905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume beb06bb0-c7c7-48e8-ae1e-439190d9c945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945', 'volume_size': 1} Jul 23 03:38:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (f7bdf81f-1e7a-412d-9172-7ebc1c55c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fe9fbc-402f-46b9-ae88-a271d29fead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fe9fbc-402f-46b9-ae88-a271d29fead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645454286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a293215-a3a7-42e3-8f0c-52c472831797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:19Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37062645-303d-436f-83e5-069ddd944234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37062645-303d-436f-83e5-069ddd944234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b4155-d945-4458-93f0-269525c0f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b4155-d945-4458-93f0-269525c0f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a293215-a3a7-42e3-8f0c-52c472831797', 'volume_name': 'volume-4a293215-a3a7-42e3-8f0c-52c472831797', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461559d9-5c8b-4dcf-8be7-7f5890a7f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461559d9-5c8b-4dcf-8be7-7f5890a7f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d237a208-b8e0-4824-8b8d-647afc30abaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:18 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume 4a293215-a3a7-42e3-8f0c-52c472831797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a293215-a3a7-42e3-8f0c-52c472831797', 'volume_size': 1} Jul 23 03:38:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:21 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912" returned: 0 in 4.705s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a493d71-8cb5-47ba-8b25-e870f6c9ca87]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:21 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:21 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:21 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.528s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:38:21 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Converted 1024.00 MB image at 217.59 MB/s Jul 23 03:38:21 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 is being set with open permissions: ugo+rw Jul 23 03:38:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:21 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 Jul 23 03:38:21 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:22 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912" returned: 0 in 0.239s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" released by "_copy_volume_from_snapshot" :: held 6.535s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce-a4ad577a-864c-447f-a5a1-653305f10912" released by "_create_volume_from_snapshot" :: held 6.575s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.608s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.177s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc1c7d-c038-4865-8814-67ca58449f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6211535e1e844e2895bfbb306db8a17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:12Z,use_quota=True,user_id='cd142ee7f428425dba3b25f2863f3a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf5cd5bc-64ab-4f37-ab8b-11665c8fbaa7),volume_type_id=cf5cd5bc-64ab-4f37-ab8b-11665c8fbaa7)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Creating volume c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:22 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:22 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1073741824 Jul 23 03:38:22 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d975a755-6350-4d59-8257-c912856af155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ad577a-864c-447f-a5a1-653305f10912', 'volume_size': 1, 'snapshot_id': '290d70df-d87f-4e91-8fcc-8c408d5902ce'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e129b458-244e-4096-8175-430d0541cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:22 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Volume volume-a4ad577a-864c-447f-a5a1-653305f10912 (a4ad577a-864c-447f-a5a1-653305f10912): created successfully Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e129b458-244e-4096-8175-430d0541cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Flow 'volume_create_manager' (b041e453-c1c7-474e-ad99-e29dce6f642b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2d41269e-73c3-4ac7-b77b-dae4b0dc3276 tempest-VolumeDependencyTests-712625145 None] Created volume successfully. Jul 23 03:38:22 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1073741824" returned: 0 in 0.408s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:22 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 Jul 23 03:38:22 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:22 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69" returned: 0 in 0.248s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.673s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040019054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b754b6e9-4a9c-4d83-9766-032c2ed355b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:16Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume b754b6e9-4a9c-4d83-9766-032c2ed355b0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:22 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:22 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 1073741824 Jul 23 03:38:22 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Attempting download of 8725a542-2a93-401e-be1f-6493a9e8d62a ((None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}])) to volume c1fc1c7d-c038-4865-8814-67ca58449f69. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f2221e-9063-4ce9-9e10-9ca216cbe418]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-290d70df-d87f-4e91-8fcc-8c408d5902ce-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-290d70df-d87f-4e91-8fcc-8c408d5902ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:22 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:22 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu Jul 23 03:38:22 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Deleting offline snapshot 290d70df-d87f-4e91-8fcc-8c408d5902ce of volume 0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] snapshot_file for this snap is: volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781df46-4d55-4efe-a375-e50f6fc2f6f4]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:23 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 1073741824" returned: 0 in 0.464s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu" returned: 0 in 0.404s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 Jul 23 03:38:23 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu Jul 23 03:38:23 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.372s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd31f1-8924-428d-a9ad-b630b1dca233]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:23 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.033s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61708926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29138a2-ed7a-4408-98de-f7267a6ec3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:16Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume d29138a2-ed7a-4408-98de-f7267a6ec3b1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:23 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 1073741824 Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011ee37c-367a-44ac-a43d-183a89531519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:23 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bfdc4-1b10-4fec-8343-a318e6b9bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:23 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 (b754b6e9-4a9c-4d83-9766-032c2ed355b0): created successfully Jul 23 03:38:23 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bfdc4-1b10-4fec-8343-a318e6b9bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (b8249b52-908e-4e17-95ee-912b708ea61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu" returned: 1 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8725a542-2a93-401e-be1f-6493a9e8d62a_ibkyrocu' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[028662a9-87c6-4198-ac2d-7eeaa12738fe]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b19f93e2-f608-43c0-b515-21ba7e29cc04 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:23 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:23 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:23 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.416s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:23 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:23 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 1073741824" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 Jul 23 03:38:24 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD Jul 23 03:38:24 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce Jul 23 03:38:24 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1" returned: 0 in 0.254s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.765s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:24 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot d75d97ed-91cd-4d0b-8331-608c9c7f208d of volume faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa66e4b8-5be4-4194-87bc-e39b9d997234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33d2fed-9e67-40c2-954e-e3aa4c162c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] 8725a542-2a93-401e-be1f-6493a9e8d62a was raw, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc66b5-8a73-4d3d-bb18-915273d71bb9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 Jul 23 03:38:24 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 (d29138a2-ed7a-4408-98de-f7267a6ec3b1): created successfully Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33d2fed-9e67-40c2-954e-e3aa4c162c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (bc1de4d3-998a-43d1-b72c-604b36c39b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1d9b25d0-cadf-4aa8-b0ba-14f3161ddbd6 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:24 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1.290d70df-d87f-4e91-8fcc-8c408d5902ce" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-290d70df-d87f-4e91-8fcc-8c408d5902ce" released by "_delete_snapshot" :: held 1.561s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" released by "delete_snapshot" :: held 1.595s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:24 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 Jul 23 03:38:24 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Created reservations ['aab16f67-451e-470f-a4ed-1e3dbe5eb7c7', '5a38f85b-b024-401a-9b19-c2797e4eec9e', '4ad0de49-3285-46f7-86e5-8f02730cef58', '52e33390-82c3-457e-8ea7-15fed6346b72'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Delete snapshot completed successfully. Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-1ecfa083-7f40-4a0b-a943-647be31ac74f tempest-VolumeDependencyTests-712625145 None] Lock "cinder-290d70df-d87f-4e91-8fcc-8c408d5902ce-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:24 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" returned: 0 in 0.457s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69" returned: 0 in 0.511s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8725a542-2a93-401e-be1f-6493a9e8d62a_jubvksgzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:38:24 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:38:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:24 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d 1G Jul 23 03:38:24 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:24 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1G Jul 23 03:38:24 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-0864db5c-fa61-477d-b09f-83db8cfdc6d1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "cinder-0864db5c-fa61-477d-b09f-83db8cfdc6d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8bac0e-cfe2-4928-bfc9-1dfb8434e28a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:25 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 1G" returned: 0 in 0.377s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Downloaded image 8725a542-2a93-401e-be1f-6493a9e8d62a ((None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}])) to volume c1fc1c7d-c038-4865-8814-67ca58449f69 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Temporary image 8725a542-2a93-401e-be1f-6493a9e8d62a for user cd142ee7f428425dba3b25f2863f3a55 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Marking volume c1fc1c7d-c038-4865-8814-67ca58449f69 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Copying metadata from image 8725a542-2a93-401e-be1f-6493a9e8d62a to c1fc1c7d-c038-4865-8814-67ca58449f69. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Creating volume glance metadata for volume c1fc1c7d-c038-4865-8814-67ca58449f69 backed by image 8725a542-2a93-401e-be1f-6493a9e8d62a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '912b62a79358b74a993936e7a097156b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:38:25 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d 1G" returned: 0 in 0.468s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:25 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d Jul 23 03:38:25 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32bc71-8047-4684-aa2f-acdc31cda793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fc1c7d-c038-4865-8814-67ca58449f69', 'volume_size': 1, 'image_id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8725a542-2a93-401e-be1f-6493a9e8d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '912b62a79358b74a993936e7a097156b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6211535e1e844e2895bfbb306db8a17a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c919bc125dfb43de5be67385d03a5575450a7a138424d3822190f854eab7909fe75868aa278cedf9e6626db3386062375cc276431a574c05e1ba9d38ab73d9a1', 'id': '8725a542-2a93-401e-be1f-6493a9e8d62a', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8725a542-2a93-401e-be1f-6493a9e8d62a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:25 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:25 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1431a51-65cc-4fdc-b4e9-406d11989173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:25 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Volume volume-c1fc1c7d-c038-4865-8814-67ca58449f69 (c1fc1c7d-c038-4865-8814-67ca58449f69): created successfully Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1431a51-65cc-4fdc-b4e9-406d11989173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Flow 'volume_create_manager' (b0a86cf7-52a0-4a99-a60e-47a5a1988b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4841179a-9e0a-4a94-9478-5b8d41106df3 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Created volume successfully. Jul 23 03:38:25 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:25 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d is being set with open permissions: ugo+rw Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:25 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1 Jul 23 03:38:25 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:25 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d Jul 23 03:38:25 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:25 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0864db5c-fa61-477d-b09f-83db8cfdc6d1" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-0864db5c-fa61-477d-b09f-83db8cfdc6d1" released by "delete_volume" :: held 0.712s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:25 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Created reservations ['cd6d88eb-cfe5-4bdd-bf1c-d125d86dc254', 'c6d049dc-9657-4181-ad88-48ad7440a47e', '08c559e9-11a1-4481-a162-e1c3684efbae', '4dc354d4-b30a-4317-b9a0-c9c125520dfa'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:26 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info Jul 23 03:38:26 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Acquiring lock "cinder-c1fc1c7d-c038-4865-8814-67ca58449f69-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "cinder-c1fc1c7d-c038-4865-8814-67ca58449f69-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Acquiring lock "cinder-quobyte-c1fc1c7d-c038-4865-8814-67ca58449f69" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:26 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:26 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "cinder-quobyte-c1fc1c7d-c038-4865-8814-67ca58449f69" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa592965-3dd7-433b-a709-0430f94c453c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info" returned: 0 in 0.309s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info is being set with open permissions: ugo+rw Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-a4ad577a-864c-447f-a5a1-653305f10912-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:26 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info Jul 23 03:38:26 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 Jul 23 03:38:26 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-a4ad577a-864c-447f-a5a1-653305f10912-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:26 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.346s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Deleted volume successfully. Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[71302053-c547-4624-8aed-4990e8fd48a7]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9aad77d3-74c3-4bfe-a90a-e0cd11fe1ebd tempest-VolumeDependencyTests-712625145 None] Lock "cinder-0864db5c-fa61-477d-b09f-83db8cfdc6d1-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:26 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 Jul 23 03:38:26 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69" returned: 0 in 0.445s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.info" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69 Jul 23 03:38:26 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.734s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935962484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba0f9db-d45e-486a-846b-34d7de0033a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:17Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume fba0f9db-d45e-486a-846b-34d7de0033a8 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:26 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 1073741824 Jul 23 03:38:26 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a85fc434-8a46-4a20-819f-de8fa69b4af1 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:38:26 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912" returned: 0 in 0.399s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:26 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912 Jul 23 03:38:26 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:26 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-c1fc1c7d-c038-4865-8814-67ca58449f69" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "cinder-quobyte-c1fc1c7d-c038-4865-8814-67ca58449f69" released by "delete_volume" :: held 0.787s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Created reservations ['c11e27ef-7871-47c9-aaa3-619db9f57732', '9f3743c1-a5ea-4659-8320-f53bdeadbdb9', '8b2ff345-e2ab-40e3-8d0c-9c21af0ae5c9', '126a53a4-29cf-4717-b3d4-75b1e7d5a5b1'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:27 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:27 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:27 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a4ad577a-864c-447f-a5a1-653305f10912" returned: 0 in 0.319s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 1073741824" returned: 0 in 0.535s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-quobyte-a4ad577a-864c-447f-a5a1-653305f10912" released by "delete_volume" :: held 0.796s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-d75d97ed-91cd-4d0b-8331-608c9c7f208d-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d75d97ed-91cd-4d0b-8331-608c9c7f208d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:27 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 Jul 23 03:38:27 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-d75d97ed-91cd-4d0b-8331-608c9c7f208d" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Created reservations ['7ab91ac1-a7ec-49fb-ac34-e33d88823267', 'd7111c91-0f47-4011-bd2d-5b8940d32a29', '71ffb211-ac45-4f31-9531-d2c8bb6ce425', '441ad6f8-d572-4f1c-a7d2-a56cf074b72b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d75d97ed-91cd-4d0b-8331-608c9c7f208d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot d75d97ed-91cd-4d0b-8331-608c9c7f208d of volume faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c22415-707a-45d9-8f30-70d4e429eb64]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:27 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.412s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Deleted volume successfully. Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3e6f07e-1f00-466b-97cb-0c14c8470fd7 tempest-VolumeAndVolumeTypeFromImageTest-2006705488 None] Lock "cinder-c1fc1c7d-c038-4865-8814-67ca58449f69-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:27 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:27 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:27 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d Jul 23 03:38:27 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:27 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.883s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1017140197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb06bb0-c7c7-48e8-ae1e-439190d9c945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:17Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume beb06bb0-c7c7-48e8-ae1e-439190d9c945 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:27 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:27 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 1073741824 Jul 23 03:38:27 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d36325-a5ec-473c-a4b0-19242d0011d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba0f9db-d45e-486a-846b-34d7de0033a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec3fb59-dcb0-41a0-8e66-b90876a3bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:27 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-fba0f9db-d45e-486a-846b-34d7de0033a8 (fba0f9db-d45e-486a-846b-34d7de0033a8): created successfully Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec3fb59-dcb0-41a0-8e66-b90876a3bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (43c9e65d-b7d4-497c-b6ce-ef305bd98634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-45bb8b66-94d0-4c22-8c34-1e37ab1b860b tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:27 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.350s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:27 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Deleted volume successfully. Jul 23 03:38:27 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a4940d54-a93f-4d33-abfe-d7fd779d15e6 tempest-VolumeDependencyTests-712625145 None] Lock "cinder-a4ad577a-864c-447f-a5a1-653305f10912-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1536e-0e94-4073-b537-52d759b91f76]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:28 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 Jul 23 03:38:28 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:28 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 1073741824" returned: 0 in 0.585s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:28 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 Jul 23 03:38:28 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:28 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" returned: 0 in 0.432s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:28 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d Jul 23 03:38:28 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:28 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945" returned: 0 in 0.347s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.924s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645454286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a293215-a3a7-42e3-8f0c-52c472831797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89439be385d7443da913c51bb052ab8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:19Z,use_quota=True,user_id='0543b7cc0529497bbf4be2f9e4b79714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Creating volume 4a293215-a3a7-42e3-8f0c-52c472831797 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:28 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:28 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 1073741824 Jul 23 03:38:28 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0417e822-c72f-4e30-b45d-0d2098179905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efecc28-02ba-4b26-9c78-4a7a2aed4a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 (beb06bb0-c7c7-48e8-ae1e-439190d9c945): created successfully Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efecc28-02ba-4b26-9c78-4a7a2aed4a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (63991ac9-aa64-4a92-b7b2-ca2ce7465349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f3fe7ba4-0e30-46ae-b884-625458c35b6a tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:29 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d" returned: 0 in 0.618s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:29 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d Jul 23 03:38:29 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:29 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 1073741824" returned: 0 in 0.662s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:29 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86.d75d97ed-91cd-4d0b-8331-608c9c7f208d" returned: 0 in 0.348s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d75d97ed-91cd-4d0b-8331-608c9c7f208d" released by "_delete_snapshot" :: held 2.054s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" released by "delete_snapshot" :: held 2.099s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:29 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 Jul 23 03:38:29 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Created reservations ['91700b32-307d-48ed-9040-0270f5c27335', '4dba9108-bcd6-4367-9087-2307616000a7', '0660bde9-97c5-417a-94b6-2547b4c8cc0a', 'ed77c478-06a3-4618-8340-70edde57574f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f5011ce9-1d2d-4519-b254-dd227cbe6191 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d75d97ed-91cd-4d0b-8331-608c9c7f208d-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:29 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797" returned: 0 in 0.302s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d237a208-b8e0-4824-8b8d-647afc30abaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a293215-a3a7-42e3-8f0c-52c472831797', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8756acb1-632a-44ad-a7b0-5abb66955040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Volume volume-4a293215-a3a7-42e3-8f0c-52c472831797 (4a293215-a3a7-42e3-8f0c-52c472831797): created successfully Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8756acb1-632a-44ad-a7b0-5abb66955040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Flow 'volume_create_manager' (f7bdf81f-1e7a-412d-9172-7ebc1c55c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-baa37834-c9d8-4770-9d92-98b6c6dc71c5 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created volume successfully. Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "cinder-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-4a293215-a3a7-42e3-8f0c-52c472831797-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-4a293215-a3a7-42e3-8f0c-52c472831797-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" acquired by "delete_volume" :: waited 0.048s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-4a293215-a3a7-42e3-8f0c-52c472831797" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[47259ec7-e4d8-4367-8ec2-3524b2824462]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-4a293215-a3a7-42e3-8f0c-52c472831797" acquired by "delete_volume" :: waited 0.043s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[000b99df-6feb-4723-86e8-c9fb70b9067c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:31 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 Jul 23 03:38:31 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:31 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 Jul 23 03:38:31 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:31 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" returned: 0 in 0.511s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:31 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86 Jul 23 03:38:31 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:31 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797" returned: 0 in 0.505s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:31 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797 Jul 23 03:38:31 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:31 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" returned: 0 in 0.270s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86" released by "delete_volume" :: held 0.865s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:31 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4a293215-a3a7-42e3-8f0c-52c472831797" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-4a293215-a3a7-42e3-8f0c-52c472831797" released by "delete_volume" :: held 0.880s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Created reservations ['88d31639-4c3b-4656-9ab4-faf7fc060059', 'e22829ee-d0bc-4303-a2c2-b14d4d659789', 'ae345183-c1ef-428d-a077-4fdd9805a34d', 'd045b487-a00f-4fcb-970c-f6407ab2984d'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['cb185476-102f-429d-a658-558e408e89bd', '85a566c7-61aa-46f0-9c17-2cd6d448fa69', 'b715212e-1c61-4671-b744-25fbac35f231', 'c4aea586-c2bf-4349-85e4-8d0abf7934fc'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:31 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:31 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:32 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:32 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:32 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.311s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-9097cad4-9a01-45df-ade9-1209b047cc55 tempest-ProjectMemberTests-670957881 None] Lock "cinder-faf3938b-e9ee-4dd6-8eca-acca7e2e9a86-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:32 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:32 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8b2e163e-ef2f-47b9-88cf-331601b8f737 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-4a293215-a3a7-42e3-8f0c-52c472831797-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-beb06bb0-c7c7-48e8-ae1e-439190d9c945-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-beb06bb0-c7c7-48e8-ae1e-439190d9c945-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-beb06bb0-c7c7-48e8-ae1e-439190d9c945" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-beb06bb0-c7c7-48e8-ae1e-439190d9c945" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d31d7a-a969-49b9-bbe8-2d3fb5572afb]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:33 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 Jul 23 03:38:33 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:33 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945" returned: 0 in 0.459s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945 Jul 23 03:38:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (046668bc-e183-408e-8ada-d0902cc1423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8304bbe4-b6be-472b-8b2f-cc4ee8543d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (1028785a-4ab1-4edb-953c-0719341d772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ef002-33bc-472e-90b0-64c0e46bfae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8304bbe4-b6be-472b-8b2f-cc4ee8543d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507600302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1990bdf8-9766-42cb-9b27-af4184baefb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22f779f-be82-4278-a5d7-f3ff5fc004c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22f779f-be82-4278-a5d7-f3ff5fc004c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbea74e-57ca-4b1e-926c-fd897cc1b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbea74e-57ca-4b1e-926c-fd897cc1b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1990bdf8-9766-42cb-9b27-af4184baefb2', 'volume_name': 'volume-1990bdf8-9766-42cb-9b27-af4184baefb2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154f1aa6-198a-4b22-963c-8c2f11ed87f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154f1aa6-198a-4b22-963c-8c2f11ed87f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bdb60e-080b-40ff-8693-f9fda36e3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Volume 1990bdf8-9766-42cb-9b27-af4184baefb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1990bdf8-9766-42cb-9b27-af4184baefb2', 'volume_size': 1} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507600302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1990bdf8-9766-42cb-9b27-af4184baefb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Creating volume 1990bdf8-9766-42cb-9b27-af4184baefb2 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:33 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ef002-33bc-472e-90b0-64c0e46bfae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875105549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e45f5f-4fcc-4191-beb0-7b267528f7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8c7b3-2dd2-4ccc-8c92-4cb44c5a662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8c7b3-2dd2-4ccc-8c92-4cb44c5a662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 1073741824 Jul 23 03:38:33 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3eeffd-da14-45c7-a0bc-b4ddf34507c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3eeffd-da14-45c7-a0bc-b4ddf34507c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e45f5f-4fcc-4191-beb0-7b267528f7c9', 'volume_name': 'volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd57982-81f4-40de-a197-5b2e0b77a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd57982-81f4-40de-a197-5b2e0b77a74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70b68cc-7890-4114-9a5f-a577f8635c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:33 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Volume e0e45f5f-4fcc-4191-beb0-7b267528f7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9', 'volume_size': 1} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-beb06bb0-c7c7-48e8-ae1e-439190d9c945" returned: 0 in 0.350s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-beb06bb0-c7c7-48e8-ae1e-439190d9c945" released by "delete_volume" :: held 0.869s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['0a3dcaa7-88bd-405d-b4df-089f2446b83f', '941855d9-ffe3-4ec5-a14e-536c5575fcc3', 'f75a8511-4fa1-4c7d-af22-2bfdac9cc1e0', 'f3acc1d8-c6af-414e-8466-f12d2817307c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (6772a110-7722-4dde-941a-562e640b8701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f42f76-e6be-48f4-af12-ec641ec5ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f42f76-e6be-48f4-af12-ec641ec5ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883073999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537ff116-11ac-4aa1-8580-d3c0ecf4fdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537ff116-11ac-4aa1-8580-d3c0ecf4fdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a21712-7516-41fd-b042-79cde63deb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a21712-7516-41fd-b042-79cde63deb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c', 'volume_name': 'volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f47ac0-65b0-422c-a859-9a253cb1011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f47ac0-65b0-422c-a859-9a253cb1011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49346480-f954-40a7-b7a9-efbe2dc3c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Volume f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c', 'volume_size': 1} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (449f9695-c7d1-44ca-8d9d-1786140beb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933033f9-9353-41e1-914f-a171c6b64a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933033f9-9353-41e1-914f-a171c6b64a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703160865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7b906-d7dd-4dfc-b78c-8eb91bc585c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983d11a8-fb74-4b6c-a3d5-f81d0f740a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983d11a8-fb74-4b6c-a3d5-f81d0f740a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9d5f20-f354-4309-b70c-e881b49d6f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9d5f20-f354-4309-b70c-e881b49d6f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b7b906-d7dd-4dfc-b78c-8eb91bc585c9', 'volume_name': 'volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de77381-871b-44d4-a611-0fae75401b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de77381-871b-44d4-a611-0fae75401b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31248761-ba5b-482c-8de5-5243cf0a7fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Volume 17b7b906-d7dd-4dfc-b78c-8eb91bc585c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9', 'volume_size': 1} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:34 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:34 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-fba0f9db-d45e-486a-846b-34d7de0033a8-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-fba0f9db-d45e-486a-846b-34d7de0033a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-fba0f9db-d45e-486a-846b-34d7de0033a8" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-fba0f9db-d45e-486a-846b-34d7de0033a8" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:34 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 1073741824" returned: 0 in 0.773s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4b20ef-89bc-4588-b26a-e32f433fc3c8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:34 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 Jul 23 03:38:34 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:34 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.319s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:34 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3734d5c7-1ea4-4cba-9eb6-8f72d02e4c08 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-beb06bb0-c7c7-48e8-ae1e-439190d9c945-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:34 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 Jul 23 03:38:34 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (10baa28b-ebf7-417e-bebc-601ffd786f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e2254c-98f1-4641-b0e5-4429c92b2492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e2254c-98f1-4641-b0e5-4429c92b2492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1881487607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:35Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9064a3f-9573-4ffd-8b38-f7381f73b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9064a3f-9573-4ffd-8b38-f7381f73b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757ca5f3-a4ee-4dfd-8420-a758d363243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757ca5f3-a4ee-4dfd-8420-a758d363243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1', 'volume_name': 'volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1f27ef-a877-4b26-9d91-8e5c77517b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1f27ef-a877-4b26-9d91-8e5c77517b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ec92b4-5b92-4215-848f-1e35582aa7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Volume f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1', 'volume_size': 1} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:35 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2" returned: 0 in 0.357s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875105549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e45f5f-4fcc-4191-beb0-7b267528f7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Creating volume e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:35 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bdb60e-080b-40ff-8693-f9fda36e3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1990bdf8-9766-42cb-9b27-af4184baefb2', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86feabc-7c39-4ce4-ab65-5c2e00695fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 1073741824 Jul 23 03:38:35 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Volume volume-1990bdf8-9766-42cb-9b27-af4184baefb2 (1990bdf8-9766-42cb-9b27-af4184baefb2): created successfully Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86feabc-7c39-4ce4-ab65-5c2e00695fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (046668bc-e183-408e-8ada-d0902cc1423c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-21a1e4d7-f40b-474b-86c6-4b3409e57617 tempest-CreateVolumesFromImageTest-918177378 None] Created volume successfully. Jul 23 03:38:35 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8" returned: 0 in 0.590s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:35 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8 Jul 23 03:38:35 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:35 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fba0f9db-d45e-486a-846b-34d7de0033a8" returned: 0 in 0.348s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-fba0f9db-d45e-486a-846b-34d7de0033a8" released by "delete_volume" :: held 0.990s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['033e6df1-ebcd-4439-98eb-cb9295139754', 'fc2741c7-fa33-4370-88d9-2aea07171c72', 'de3204d7-6cf1-4e7f-b516-0d3eefd12c15', '3303b315-a017-4718-9f78-a37f5c3156ee'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:35 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 1073741824" returned: 0 in 0.631s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (506a0386-c2b4-44d7-a70d-17c264115836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75905bc6-1e65-463c-9532-825b1f031b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75905bc6-1e65-463c-9532-825b1f031b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1015659815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fad58-fb17-479f-aa7e-972202e767ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:36Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe190d7-8570-403e-a8ac-92e35d7e0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe190d7-8570-403e-a8ac-92e35d7e0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f1299d-bf1f-4395-8b7a-a043b7c96ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f1299d-bf1f-4395-8b7a-a043b7c96ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4fad58-fb17-479f-aa7e-972202e767ca', 'volume_name': 'volume-2f4fad58-fb17-479f-aa7e-972202e767ca', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ba906c-8cae-4e6b-a68f-9db86906ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ba906c-8cae-4e6b-a68f-9db86906ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd7ee3f-7832-4770-abfb-abbaf46d99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Volume 2f4fad58-fb17-479f-aa7e-972202e767ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4fad58-fb17-479f-aa7e-972202e767ca', 'volume_size': 1} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:35 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 Jul 23 03:38:35 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-d29138a2-ed7a-4408-98de-f7267a6ec3b1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:35 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:35 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:35 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:35 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-d29138a2-ed7a-4408-98de-f7267a6ec3b1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-d29138a2-ed7a-4408-98de-f7267a6ec3b1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-d29138a2-ed7a-4408-98de-f7267a6ec3b1" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b179f4a1-ce51-426b-ae83-c14b26762aec]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:36 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883073999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Creating volume f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:36 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:36 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70b68cc-7890-4114-9a5f-a577f8635c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3007fe1e-3193-4047-8798-a186a02e3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:36 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c 1073741824 Jul 23 03:38:36 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.331s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 28 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:38:36 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Volume volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 (e0e45f5f-4fcc-4191-beb0-7b267528f7c9): created successfully Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3007fe1e-3193-4047-8798-a186a02e3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (1028785a-4ab1-4edb-953c-0719341d772d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:36 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-78d149c7-847a-469d-9c9f-753e62779cc3 tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:38:36 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 Jul 23 03:38:36 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.347s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:36 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-54da8a0c-677a-4b65-b66a-2baefb998ef8 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-fba0f9db-d45e-486a-846b-34d7de0033a8-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:36 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1" returned: 0 in 0.440s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:36 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1 Jul 23 03:38:36 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:36 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c 1073741824" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:36 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c Jul 23 03:38:36 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:36 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d29138a2-ed7a-4408-98de-f7267a6ec3b1" returned: 0 in 0.396s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-d29138a2-ed7a-4408-98de-f7267a6ec3b1" released by "delete_volume" :: held 0.933s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['9771a618-b6a1-4449-b8a9-3b2ff0467888', 'e641ba1b-2934-46db-b396-e8cea08686b7', '92225599-57fd-493c-96db-6c32a9aad56c', '89c9bfc5-2b87-45b6-afd4-99dbba5661d6'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:37 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.641s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703160865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7b906-d7dd-4dfc-b78c-8eb91bc585c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:34Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Creating volume 17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49346480-f954-40a7-b7a9-efbe2dc3c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:37 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 1073741824 Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f94487-922d-4e4b-a265-807410792db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:37 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Volume volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c (f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c): created successfully Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f94487-922d-4e4b-a265-807410792db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (6772a110-7722-4dde-941a-562e640b8701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7602d3a6-aeb8-4b01-9f86-55bf8381b7a3 tempest-CreateVolumesFromImageTest-918177378 None] Created volume successfully. Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:37 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:37 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:37 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c93dcf96-57e9-44ba-9a61-ea2017dd7b9e tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-d29138a2-ed7a-4408-98de-f7267a6ec3b1-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:37 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 1073741824" returned: 0 in 0.538s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:37 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 Jul 23 03:38:37 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:37 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" returned: 0 in 0.259s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1881487607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:35Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Creating volume f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31248761-ba5b-482c-8de5-5243cf0a7fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:37 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 1073741824 Jul 23 03:38:37 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57d1fee-2b55-48f6-80c4-972fb14c0f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Volume volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 (17b7b906-d7dd-4dfc-b78c-8eb91bc585c9): created successfully Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57d1fee-2b55-48f6-80c4-972fb14c0f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:37 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (449f9695-c7d1-44ca-8d9d-1786140beb46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-662a4b27-da06-4235-b603-c3f1968df6cd tempest-CreateVolumesFromImageTest-918177378 None] Created volume successfully. Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-b754b6e9-4a9c-4d83-9766-032c2ed355b0-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-b754b6e9-4a9c-4d83-9766-032c2ed355b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-b754b6e9-4a9c-4d83-9766-032c2ed355b0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-b754b6e9-4a9c-4d83-9766-032c2ed355b0" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c157bc4-d009-4b23-8cf1-9d9893a63a7c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:38 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 Jul 23 03:38:38 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:38 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 1073741824" returned: 0 in 0.448s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:38 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 Jul 23 03:38:38 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:38 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:38 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0 Jul 23 03:38:38 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:38 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1015659815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fad58-fb17-479f-aa7e-972202e767ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27efecfdada94eeebc351691990251e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:36Z,use_quota=True,user_id='14f2add9a93444a3a42a9901becd4e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Creating volume 2f4fad58-fb17-479f-aa7e-972202e767ca {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:38 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ec92b4-5b92-4215-848f-1e35582aa7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd30e0ab-d048-4fba-a9c1-5e943dddf966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:38 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca 1073741824 Jul 23 03:38:38 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Volume volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 (f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1): created successfully Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd30e0ab-d048-4fba-a9c1-5e943dddf966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (10baa28b-ebf7-417e-bebc-601ffd786f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-de6a92ff-e66f-40d8-8ea6-7b4424a1965c tempest-CreateVolumesFromImageTest-918177378 None] Created volume successfully. Jul 23 03:38:38 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b754b6e9-4a9c-4d83-9766-032c2ed355b0" returned: 0 in 0.298s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-b754b6e9-4a9c-4d83-9766-032c2ed355b0" released by "delete_volume" :: held 0.716s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:38 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['817d44e9-f156-4704-be61-46e2ab6bcb96', '8726d5ed-9faa-40bc-8fa4-47e334a74259', '6f889904-110b-406d-a198-f58c13fd54ce', '44a2ae6b-6c65-417e-91a8-29aa1e9fd99b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:39 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:39 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:39 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca 1073741824" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-ec8421d4-4aca-4299-9536-a096190136b9-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:39 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:39 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca Jul 23 03:38:39 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-ec8421d4-4aca-4299-9536-a096190136b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5611d549-aae8-4c9f-993c-eba3609aed60 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-b754b6e9-4a9c-4d83-9766-032c2ed355b0-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-ec8421d4-4aca-4299-9536-a096190136b9" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-ec8421d4-4aca-4299-9536-a096190136b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleting offline snapshot ec8421d4-4aca-4299-9536-a096190136b9 of volume 3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] snapshot_file for this snap is: volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fb8d7-35a9-4923-877c-36a2414e45f2]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:39 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 Jul 23 03:38:39 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:39 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.708s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd7ee3f-7832-4770-abfb-abbaf46d99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4fad58-fb17-479f-aa7e-972202e767ca', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40a2b2c-8d64-4d97-85ea-8ab4318f6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot 97526dfc-6241-400a-94ae-96f84c13b974 of volume e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:38:39 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Volume volume-2f4fad58-fb17-479f-aa7e-972202e767ca (2f4fad58-fb17-479f-aa7e-972202e767ca): created successfully Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40a2b2c-8d64-4d97-85ea-8ab4318f6189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Flow 'volume_create_manager' (506a0386-c2b4-44d7-a70d-17c264115836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e54817-6b29-4efe-a788-e449f2214782]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:39 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0ee34677-c185-412e-a77b-b965baf269e2 tempest-CreateVolumesFromImageTest-918177378 None] Created volume successfully. Jul 23 03:38:39 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 Jul 23 03:38:39 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9" returned: 0 in 0.452s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3223b548-b772-4e2d-8f4b-e299bc74ec32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad71834-2f5f-470c-bfad-c67df0a1af0a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-2f4fad58-fb17-479f-aa7e-972202e767ca-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-2f4fad58-fb17-479f-aa7e-972202e767ca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:40 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 Jul 23 03:38:40 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-quobyte-2f4fad58-fb17-479f-aa7e-972202e767ca" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:40 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" returned: 0 in 0.519s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-2f4fad58-fb17-479f-aa7e-972202e767ca" acquired by "delete_volume" :: waited 0.047s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:40 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 1G Jul 23 03:38:40 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[820126d4-6e94-45cd-a2f7-b4c34b9d05dd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca Jul 23 03:38:40 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32" returned: 0 in 0.500s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 Jul 23 03:38:40 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca" returned: 0 in 0.466s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 1G" returned: 0 in 0.563s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca Jul 23 03:38:40 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 Jul 23 03:38:40 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:40 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9" returned: 0 in 0.470s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:40 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9 Jul 23 03:38:40 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:41 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-2f4fad58-fb17-479f-aa7e-972202e767ca" returned: 0 in 0.294s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-2f4fad58-fb17-479f-aa7e-972202e767ca" released by "delete_volume" :: held 0.832s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:41 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974" returned: 0 in 0.347s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:41 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 is being set with open permissions: ugo+rw Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Created reservations ['84b9a8b1-0e08-48b8-871f-6784b7796b39', '2e2ecbdd-ded1-4f63-8c15-54eff8459670', '401590d3-268b-4a40-8854-fd73fb773808', '013e4fee-432c-4422-9d79-9887bdc1546b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:41 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 Jul 23 03:38:41 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32.ec8421d4-4aca-4299-9536-a096190136b9" returned: 0 in 0.307s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:41 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:41 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:41 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-ec8421d4-4aca-4299-9536-a096190136b9" released by "_delete_snapshot" :: held 2.007s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" released by "delete_snapshot" :: held 2.055s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-quobyte-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" acquired by "delete_volume" :: waited 0.052s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:41 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc51605-9bc7-40c6-9457-e362f288ec57]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974" returned: 0 in 0.520s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:41 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.419s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Deleted volume successfully. Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['80d541e6-68b8-4072-b6d6-9c9d7feb76bc', '09a19d68-2be2-4229-bf51-63a7dc60e9c9', '15689d56-f6eb-463a-a78e-8ff7ac14b583', '06d26a37-671d-489c-978b-ac0845197dfa'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e3068e1c-cd86-48ac-b690-7612a2e90799 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-2f4fad58-fb17-479f-aa7e-972202e767ca-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:41 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info Jul 23 03:38:41 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Delete snapshot completed successfully. Jul 23 03:38:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3321f4fb-da89-4802-a9e0-7443c4d02585 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-ec8421d4-4aca-4299-9536-a096190136b9-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:41 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 Jul 23 03:38:41 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:42 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info" returned: 0 in 0.326s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:42 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info is being set with open permissions: ugo+rw Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:42 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info Jul 23 03:38:42 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:42 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" returned: 0 in 0.594s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:42 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1 Jul 23 03:38:42 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:42 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.info" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-84dfc4bb-17a9-4fd3-809e-ed8e9a4e5ff3 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:38:42 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" returned: 0 in 0.299s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1" released by "delete_volume" :: held 0.956s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-3223b548-b772-4e2d-8f4b-e299bc74ec32-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-3223b548-b772-4e2d-8f4b-e299bc74ec32-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Created reservations ['338c0b96-2bcd-44fa-96f4-e4b8f09423e2', 'cfcd948d-bf17-40c1-ab4e-f50b153ca8ba', '619499bd-8b76-4427-b339-dc2a152e6af8', '590eebeb-4cf3-459a-b0d2-a3efc715a72f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" acquired by "delete_volume" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbad70-e6cf-4e2d-9912-654500ca6dde]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:42 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:42 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:42 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 Jul 23 03:38:42 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:43 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Deleted volume successfully. Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e7721a03-6409-452b-8f35-932978c9d209 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-f85fc24e-e6c4-4a67-9744-01bd6dd1d4d1-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:43 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32" returned: 0 in 0.395s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:43 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32 Jul 23 03:38:43 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-97526dfc-6241-400a-94ae-96f84c13b974-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-97526dfc-6241-400a-94ae-96f84c13b974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-97526dfc-6241-400a-94ae-96f84c13b974" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-97526dfc-6241-400a-94ae-96f84c13b974" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot 97526dfc-6241-400a-94ae-96f84c13b974 of volume e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[524bea04-8d2e-43b5-8064-2f872e56733e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:43 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-3223b548-b772-4e2d-8f4b-e299bc74ec32" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:43 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 Jul 23 03:38:43 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-quobyte-3223b548-b772-4e2d-8f4b-e299bc74ec32" released by "delete_volume" :: held 0.739s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Created reservations ['e469cdba-083f-42fe-a6cb-b8232c55408f', 'ea7cb934-fe0e-4092-abc6-ced775081f2b', 'd352cc38-be46-4510-ada5-6b555dd952b7', '811709ef-7d39-4401-9545-8715798d8530'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:43 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:43 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-quobyte-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:43 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974" returned: 0 in 0.531s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee74c40-7d16-4380-a55a-794c510a9d4a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[19728a07-1bd1-431c-9a42-5b4cee8ff1bc]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:43 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.345s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:43 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Deleted volume successfully. Jul 23 03:38:43 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 Jul 23 03:38:43 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 Jul 23 03:38:44 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-a83a29bf-47f2-440b-96c3-00606c28b686 tempest-CreateVolumesFromSnapshotTest-909219860 None] Lock "cinder-3223b548-b772-4e2d-8f4b-e299bc74ec32-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:44 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" returned: 0 in 0.425s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:44 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" returned: 0 in 0.423s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:44 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9 Jul 23 03:38:44 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 Jul 23 03:38:44 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9" released by "delete_volume" :: held 0.775s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Created reservations ['21042b40-dae9-4bca-9d04-e3426a75ea46', '5c2a0bb2-114a-4463-81d6-3eef6991f0b6', 'ae367df5-c3a0-40e0-8268-27264b20578c', '055ae61d-40a7-4d77-a89a-b74d24c4356e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:44 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974" returned: 0 in 0.473s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:44 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:44 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974 Jul 23 03:38:44 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-quobyte-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:45 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.368s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Deleted volume successfully. Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" acquired by "delete_volume" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-49b22b57-9cbc-444c-b92e-c09b14be7304 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-17b7b906-d7dd-4dfc-b78c-8eb91bc585c9-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288c731-d9a3-49b4-a416-0e5a515104ee]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:45 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9.97526dfc-6241-400a-94ae-96f84c13b974" returned: 0 in 0.429s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-97526dfc-6241-400a-94ae-96f84c13b974" released by "_delete_snapshot" :: held 2.013s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" released by "delete_snapshot" :: held 2.043s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:45 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c Jul 23 03:38:45 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Created reservations ['d2ebc7bb-6976-4718-92fe-02afa2af78c3', '6325048d-e55e-4c8c-a352-2f321b0f260d', 'cd5e80fb-1367-4423-b6cd-b0fd127360d0', 'f0efc985-22f4-49b0-af6c-aabac219c494'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:45 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-90b5abe7-2fad-4a88-8836-1f186d8c7c47 tempest-ProjectMemberTests-670957881 None] Lock "cinder-97526dfc-6241-400a-94ae-96f84c13b974-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:45 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" returned: 0 in 0.438s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:45 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c Jul 23 03:38:45 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:45 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c" released by "delete_volume" :: held 0.778s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:45 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Created reservations ['9fb369a7-4a3a-46fb-becc-43b0e2c46f45', '31336f06-7fb4-4f57-b2e6-61472bd812a1', '2d5d6b15-f747-4454-940f-a3a6727ad718', '9dbb6286-f6ea-44bd-a476-3a0e30938fb4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:46 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:46 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-1990bdf8-9766-42cb-9b27-af4184baefb2-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-1990bdf8-9766-42cb-9b27-af4184baefb2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "cinder-quobyte-1990bdf8-9766-42cb-9b27-af4184baefb2" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-1990bdf8-9766-42cb-9b27-af4184baefb2" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[91485c46-6532-4d4a-a2e2-b2dd5d60a118]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:46 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.335s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Deleted volume successfully. Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-75ab3b08-c834-46e7-918a-f0f2bfd21c5e tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-f3e9c0ac-290e-4c8c-b264-0f7bdfc0037c-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-e0e45f5f-4fcc-4191-beb0-7b267528f7c9-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "cinder-e0e45f5f-4fcc-4191-beb0-7b267528f7c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:46 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 Jul 23 03:38:46 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[08573ae2-a0c2-4556-a525-1d172407f3c8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:46 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 Jul 23 03:38:46 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:46 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2" returned: 0 in 0.478s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:46 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2 Jul 23 03:38:46 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:47 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" returned: 0 in 0.390s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:47 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9 Jul 23 03:38:47 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:47 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-1990bdf8-9766-42cb-9b27-af4184baefb2" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-quobyte-1990bdf8-9766-42cb-9b27-af4184baefb2" released by "delete_volume" :: held 0.801s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Created reservations ['97a3e569-83f8-4627-9a6a-506d29501a95', '9b56fe79-e944-404f-aa48-104a65a9536d', '71fbd209-bf59-4c8c-83e6-609b97e8ccfd', '557f5a25-7064-4eb7-9ed0-e37364b535ec'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:47 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:47 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:47 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" returned: 0 in 0.328s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-e0e45f5f-4fcc-4191-beb0-7b267528f7c9" released by "delete_volume" :: held 0.806s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Created reservations ['d1d3d6bb-7173-4cfd-be4a-85543738e72d', 'e626faab-366a-4d5f-b49b-749545d9fe19', '33cfff2e-714a-432b-a9aa-70e850cb7c0e', '9fcd17c1-f79d-461b-9803-56b026564927'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (011d1605-de23-4982-befb-631356dac3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcd2ca0-e048-47f4-88c8-4d8f8a3dd7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcd2ca0-e048-47f4-88c8-4d8f8a3dd7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509328813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def157b0-d7b9-4530-9716-4a64bc4b247f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:47Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e35a87-598e-4bf7-bace-a19e13d505b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e35a87-598e-4bf7-bace-a19e13d505b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25df5026-857d-4822-afc2-b830ecddc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25df5026-857d-4822-afc2-b830ecddc72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def157b0-d7b9-4530-9716-4a64bc4b247f', 'volume_name': 'volume-def157b0-d7b9-4530-9716-4a64bc4b247f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c208249-8ab2-455c-916d-1119c29bb965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c208249-8ab2-455c-916d-1119c29bb965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3ca6f2-3982-4339-8416-bcab55163b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume def157b0-d7b9-4530-9716-4a64bc4b247f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def157b0-d7b9-4530-9716-4a64bc4b247f', 'volume_size': 1} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509328813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def157b0-d7b9-4530-9716-4a64bc4b247f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:47Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume def157b0-d7b9-4530-9716-4a64bc4b247f {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:47 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:47 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.390s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Deleted volume successfully. Jul 23 03:38:47 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f 1073741824 Jul 23 03:38:47 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-331db053-4783-443d-9d0d-bf1023b131c0 tempest-CreateVolumesFromImageTest-918177378 None] Lock "cinder-1990bdf8-9766-42cb-9b27-af4184baefb2-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:47 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:47 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:48 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.312s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73f5e41f-547e-41c1-bcc3-3d315c10efa8 tempest-ProjectMemberTests-670957881 None] Lock "cinder-e0e45f5f-4fcc-4191-beb0-7b267528f7c9-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:48 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f 1073741824" returned: 0 in 0.584s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:48 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f Jul 23 03:38:48 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:48 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3ca6f2-3982-4339-8416-bcab55163b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def157b0-d7b9-4530-9716-4a64bc4b247f', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd9971d-fb0e-425a-b1b2-68100836dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:48 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-def157b0-d7b9-4530-9716-4a64bc4b247f (def157b0-d7b9-4530-9716-4a64bc4b247f): created successfully Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd9971d-fb0e-425a-b1b2-68100836dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:48 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (011d1605-de23-4982-befb-631356dac3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8922cc35-a258-4800-8508-41ab639878b8 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (d64b6b10-0dc8-4f6f-ba02-78fd69922b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cdd21b-0951-4965-a0bc-41e7c97ed847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cdd21b-0951-4965-a0bc-41e7c97ed847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237435400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285d7209-893a-4077-b13d-5249886d1ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:49Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41eef2f-ebcc-4858-b46c-321e019725b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41eef2f-ebcc-4858-b46c-321e019725b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ebc36d-ed90-4c0c-b903-fb162b185f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ebc36d-ed90-4c0c-b903-fb162b185f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285d7209-893a-4077-b13d-5249886d1ee7', 'volume_name': 'volume-285d7209-893a-4077-b13d-5249886d1ee7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3afa40-5135-449d-b674-f0ad74f6a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3afa40-5135-449d-b674-f0ad74f6a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c25eb9a-21a0-4cc4-b622-0af5921e5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:49 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Volume 285d7209-893a-4077-b13d-5249886d1ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285d7209-893a-4077-b13d-5249886d1ee7', 'volume_size': 1} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237435400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285d7209-893a-4077-b13d-5249886d1ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:49Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Creating volume 285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:49 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:49 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 1073741824 Jul 23 03:38:49 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:50 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 1073741824" returned: 0 in 0.676s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:50 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 Jul 23 03:38:50 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (22766b6e-d4dc-4964-9c62-4296499f3c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd17079-142c-4c9c-88be-ce6914711fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd17079-142c-4c9c-88be-ce6914711fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518206864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6799e6d-2743-4844-9619-51bf2cb304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:50Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab70b33-ff66-417d-991f-517ea5e72602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab70b33-ff66-417d-991f-517ea5e72602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f8921-5707-4046-85d7-233903d46668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f8921-5707-4046-85d7-233903d46668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6799e6d-2743-4844-9619-51bf2cb304ff', 'volume_name': 'volume-e6799e6d-2743-4844-9619-51bf2cb304ff', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7846059d-6891-4d7d-b3d9-93a813c667e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7846059d-6891-4d7d-b3d9-93a813c667e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a4e02-57f9-4f4b-9f7f-5e11cb9c94cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume e6799e6d-2743-4844-9619-51bf2cb304ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6799e6d-2743-4844-9619-51bf2cb304ff', 'volume_size': 1} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:50 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7" returned: 0 in 0.446s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518206864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6799e6d-2743-4844-9619-51bf2cb304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:50Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume e6799e6d-2743-4844-9619-51bf2cb304ff {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:50 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:50 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff 1073741824 Jul 23 03:38:50 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c25eb9a-21a0-4cc4-b622-0af5921e5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285d7209-893a-4077-b13d-5249886d1ee7', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7391e28-7c85-4b03-a644-a355ebc77a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Volume volume-285d7209-893a-4077-b13d-5249886d1ee7 (285d7209-893a-4077-b13d-5249886d1ee7): created successfully Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7391e28-7c85-4b03-a644-a355ebc77a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (d64b6b10-0dc8-4f6f-ba02-78fd69922b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c15c00c8-f85a-462a-9121-9a29c5ad321f tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (a6bca962-ed9c-4963-8495-09b7ad7bf768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf7b74c-41e3-42f1-9dad-c793ef60c44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf7b74c-41e3-42f1-9dad-c793ef60c44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105170665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1704319-e345-4713-bf9c-fe1d4a233915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:51Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37346ce-7a08-41e6-a828-939be624934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37346ce-7a08-41e6-a828-939be624934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd96204e-91e4-445c-802d-26b674ddf843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd96204e-91e4-445c-802d-26b674ddf843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1704319-e345-4713-bf9c-fe1d4a233915', 'volume_name': 'volume-d1704319-e345-4713-bf9c-fe1d4a233915', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432cf4a7-726d-4d1f-981e-fa829743a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432cf4a7-726d-4d1f-981e-fa829743a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7d4637-4ab4-414c-a5ce-7942f103171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume d1704319-e345-4713-bf9c-fe1d4a233915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1704319-e345-4713-bf9c-fe1d4a233915', 'volume_size': 1} Jul 23 03:38:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (d352cfdc-af2c-4530-8623-f60b1f11571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54701cc-cbb3-4b9f-bb71-c57a7b963415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54701cc-cbb3-4b9f-bb71-c57a7b963415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882280761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7d81c3-4b14-4adf-8a4f-d20553009733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:51Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dcff96-cd12-44ce-a8b9-93ea5e573676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dcff96-cd12-44ce-a8b9-93ea5e573676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f1b86-eeff-4b20-a3a9-d01e82c1ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f1b86-eeff-4b20-a3a9-d01e82c1ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7d81c3-4b14-4adf-8a4f-d20553009733', 'volume_name': 'volume-ab7d81c3-4b14-4adf-8a4f-d20553009733', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40cc354-1156-4166-a140-5f42ae3397d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40cc354-1156-4166-a140-5f42ae3397d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95431d80-48f1-4dbb-af0f-256538713a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume ab7d81c3-4b14-4adf-8a4f-d20553009733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7d81c3-4b14-4adf-8a4f-d20553009733', 'volume_size': 1} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:51 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff 1073741824" returned: 0 in 0.899s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:51 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff Jul 23 03:38:51 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (d5391293-2133-4568-9d10-b327eabfab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046006fb-1036-43b0-91fc-a6dc2a6c34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046006fb-1036-43b0-91fc-a6dc2a6c34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209381471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c0febb-98d7-4443-a1d7-1a648c2233d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:52Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc6baa-202a-4661-9580-342280cfe4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc6baa-202a-4661-9580-342280cfe4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e66029b-df42-4e57-8200-55fc21f6697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e66029b-df42-4e57-8200-55fc21f6697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c0febb-98d7-4443-a1d7-1a648c2233d8', 'volume_name': 'volume-10c0febb-98d7-4443-a1d7-1a648c2233d8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c537f20-5342-4776-816e-08290bc88dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c537f20-5342-4776-816e-08290bc88dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cb260-1193-4da3-860a-7bcfacdb8c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume 10c0febb-98d7-4443-a1d7-1a648c2233d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c0febb-98d7-4443-a1d7-1a648c2233d8', 'volume_size': 1} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:52 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff" returned: 0 in 0.525s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105170665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1704319-e345-4713-bf9c-fe1d4a233915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:51Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume d1704319-e345-4713-bf9c-fe1d4a233915 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:52 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:52 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 1073741824 Jul 23 03:38:52 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a4e02-57f9-4f4b-9f7f-5e11cb9c94cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6799e6d-2743-4844-9619-51bf2cb304ff', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e8c3eb-c5be-46ba-aa16-179231fd87db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-e6799e6d-2743-4844-9619-51bf2cb304ff (e6799e6d-2743-4844-9619-51bf2cb304ff): created successfully Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e8c3eb-c5be-46ba-aa16-179231fd87db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (22766b6e-d4dc-4964-9c62-4296499f3c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-cc0c5cd1-1763-4c7b-b732-31567dc9afec tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (4addcef2-3e23-4971-83f8-d0d9729d2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea6390e-fb4e-4f6c-bd63-57ee6784a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea6390e-fb4e-4f6c-bd63-57ee6784a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767939220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35390d62-7084-4ed4-b924-5efdd8d11581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:52Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6b72f8-3a99-4b9a-a21d-f73e40b7c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6b72f8-3a99-4b9a-a21d-f73e40b7c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd567204-fd57-48ea-b659-e0cc6151ca18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd567204-fd57-48ea-b659-e0cc6151ca18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35390d62-7084-4ed4-b924-5efdd8d11581', 'volume_name': 'volume-35390d62-7084-4ed4-b924-5efdd8d11581', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cb1372-63db-46ad-af53-73421696c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cb1372-63db-46ad-af53-73421696c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cc7f34-e4a9-4a7e-8bc8-847e38b9eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:52 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume 35390d62-7084-4ed4-b924-5efdd8d11581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35390d62-7084-4ed4-b924-5efdd8d11581', 'volume_size': 1} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:52 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 1073741824" returned: 0 in 0.596s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:52 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 Jul 23 03:38:52 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:53 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915" returned: 0 in 0.304s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882280761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7d81c3-4b14-4adf-8a4f-d20553009733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:51Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume ab7d81c3-4b14-4adf-8a4f-d20553009733 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:53 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7d4637-4ab4-414c-a5ce-7942f103171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1704319-e345-4713-bf9c-fe1d4a233915', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:53 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 1073741824 Jul 23 03:38:53 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e64276-e0db-4cc6-be9a-a6f2204655de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:53 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-d1704319-e345-4713-bf9c-fe1d4a233915 (d1704319-e345-4713-bf9c-fe1d4a233915): created successfully Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e64276-e0db-4cc6-be9a-a6f2204655de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (a6bca962-ed9c-4963-8495-09b7ad7bf768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-7070405e-c2f2-4f0d-964a-2030a302b901 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:53 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 1073741824" returned: 0 in 0.549s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:53 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 Jul 23 03:38:53 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:53 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.022s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209381471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c0febb-98d7-4443-a1d7-1a648c2233d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:52Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume 10c0febb-98d7-4443-a1d7-1a648c2233d8 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:54 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95431d80-48f1-4dbb-af0f-256538713a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7d81c3-4b14-4adf-8a4f-d20553009733', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86686363-e1ce-4621-8437-40e8d2e0be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:54 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 1073741824 Jul 23 03:38:54 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 (ab7d81c3-4b14-4adf-8a4f-d20553009733): created successfully Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86686363-e1ce-4621-8437-40e8d2e0be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (d352cfdc-af2c-4530-8623-f60b1f11571e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2120601e-e12b-47ca-a15b-a306c4a44a45 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:54 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 1073741824" returned: 0 in 0.497s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:54 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 Jul 23 03:38:54 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:54 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8" returned: 0 in 0.313s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.863s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cb260-1193-4da3-860a-7bcfacdb8c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c0febb-98d7-4443-a1d7-1a648c2233d8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1d454e-02b1-481e-980d-ced7d9581298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Creating offline snapshot 8659ac6e-5830-402a-ac65-6a13c2827ed6 of volume 285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:38:54 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 (10c0febb-98d7-4443-a1d7-1a648c2233d8): created successfully Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1d454e-02b1-481e-980d-ced7d9581298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (d5391293-2133-4568-9d10-b327eabfab6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd073cd-a81e-4478-bd2c-c811f204e23f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b05f3d69-5d23-4589-a194-5041a76a75d3 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:54 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Flow 'volume_create_manager' (5d467373-00c4-4860-b341-b0a0f343e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7da9ebd-727d-4efc-9713-ce6ff5fea67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7da9ebd-727d-4efc-9713-ce6ff5fea67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a473d-7b70-4c27-82f8-012c1cc7d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6015667efb14ee984d42265f7ec38aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:55Z,use_quota=True,user_id='23e8f1cb944b4d20bff6fe4144f1c212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df25af84-267c-4ce5-bc73-1901b0d1c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df25af84-267c-4ce5-bc73-1901b0d1c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 Jul 23 03:38:55 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef1d7f-bd01-4ced-85e1-43fa225fb148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.image.glance [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Creating Keystone auth plugin from conf {{(pid=88044) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Flow 'volume_create_manager' (2ef61ad6-134a-4f54-a153-6b2017ca9297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3139ba4-1fef-4d22-81fd-5891dc01c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3139ba4-1fef-4d22-81fd-5891dc01c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790707416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6fed3d-3719-4e84-97a7-90c91dd936fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ae26976624244b9259ba4b062381c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:55Z,use_quota=True,user_id='9f8c2009aa0a455b9790248b4a0addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a89375b-7062-4454-9c46-5cfdd127c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a89375b-7062-4454-9c46-5cfdd127c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f220061-50db-4cc6-a9ec-1ec0855c297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f220061-50db-4cc6-a9ec-1ec0855c297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6fed3d-3719-4e84-97a7-90c91dd936fa', 'volume_name': 'volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549c8395-4af2-494c-ba67-1810ded48277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549c8395-4af2-494c-ba67-1810ded48277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8da9d11-89a1-456a-91af-00eff4758569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Volume 4b6fed3d-3719-4e84-97a7-90c91dd936fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa', 'volume_size': 1} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:55 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:55 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 1G Jul 23 03:38:55 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef1d7f-bd01-4ced-85e1-43fa225fb148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '051a473d-7b70-4c27-82f8-012c1cc7d750', 'volume_name': 'volume-051a473d-7b70-4c27-82f8-012c1cc7d750', 'volume_size': 1, 'image_id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341a93f26dd625ef6c6f908bb54531e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6015667efb14ee984d42265f7ec38aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42b9f689f734daa18be058da418e991efb07224d4918ea49ea30a73be900358623b44427294cf8208074d5b051a6845ba6f626d3110e0841377a106828171d1e', 'id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8018b-aa2e-45d0-97a8-f4c46af67f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8018b-aa2e-45d0-97a8-f4c46af67f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f520082-28bb-4f89-ab10-50d773224506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:55 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Volume 051a473d-7b70-4c27-82f8-012c1cc7d750: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-051a473d-7b70-4c27-82f8-012c1cc7d750', 'volume_size': 1, 'image_id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341a93f26dd625ef6c6f908bb54531e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6015667efb14ee984d42265f7ec38aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42b9f689f734daa18be058da418e991efb07224d4918ea49ea30a73be900358623b44427294cf8208074d5b051a6845ba6f626d3110e0841377a106828171d1e', 'id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f/file', 'properties': {}}, 'image_service': } Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Trying to clone 051a473d-7b70-4c27-82f8-012c1cc7d750 from image 1fe251d2-1db2-4d9f-80b8-44107240ea6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}]). {{(pid=88044) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:38:55 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed55cccf-1ed9-407a-bce3-de416a5f8e7b]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:55 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:38:55 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:55 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 1G" returned: 0 in 0.392s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285d7209-893a-4077-b13d-5249886d1ee7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:55 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285d7209-893a-4077-b13d-5249886d1ee7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 Jul 23 03:38:55 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:55 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285d7209-893a-4077-b13d-5249886d1ee7 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6" returned: 0 in 0.306s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 is being set with open permissions: ugo+rw Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:38:56 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 Jul 23 03:38:56 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Temporary image 1fe251d2-1db2-4d9f-80b8-44107240ea6f is fetched for user 23e8f1cb944b4d20bff6fe4144f1c212. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:38:56 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6" returned: 0 in 0.242s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info Jul 23 03:38:56 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6309ff9-8c4f-4015-a088-c3130f704e81]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:38:56 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info is being set with open permissions: ugo+rw Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info Jul 23 03:38:56 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:38:56 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.info" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.259s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767939220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35390d62-7084-4ed4-b924-5efdd8d11581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fa682718bb4560a33a98b921b12067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:52Z,use_quota=True,user_id='dbe2306a6ae34d89920b9c9d475c4280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Creating volume 35390d62-7084-4ed4-b924-5efdd8d11581 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:56 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:56 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 1073741824 Jul 23 03:38:56 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:56 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3f4cbea8-4036-4826-92a2-957fb7512c6b tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:38:57 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-8659ac6e-5830-402a-ac65-6a13c2827ed6-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-8659ac6e-5830-402a-ac65-6a13c2827ed6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-8659ac6e-5830-402a-ac65-6a13c2827ed6" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-8659ac6e-5830-402a-ac65-6a13c2827ed6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot 8659ac6e-5830-402a-ac65-6a13c2827ed6 of volume 285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a9eaf9-c401-47f7-9cb1-7f5be5a2f0d5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:57 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 1073741824" returned: 0 in 0.460s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:57 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 Jul 23 03:38:57 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:57 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 Jul 23 03:38:57 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:57 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-285d7209-893a-4077-b13d-5249886d1ee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:57 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790707416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6fed3d-3719-4e84-97a7-90c91dd936fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ae26976624244b9259ba4b062381c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:55Z,use_quota=True,user_id='9f8c2009aa0a455b9790248b4a0addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Creating volume 4b6fed3d-3719-4e84-97a7-90c91dd936fa {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:57 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ee7ce-2c9e-4d05-b8d5-8b677f004be8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:57 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa 1073741824 Jul 23 03:38:57 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cc7f34-e4a9-4a7e-8bc8-847e38b9eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35390d62-7084-4ed4-b924-5efdd8d11581', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9ef83e-b9eb-448d-b750-e50a0abd9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:57 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Volume volume-35390d62-7084-4ed4-b924-5efdd8d11581 (35390d62-7084-4ed4-b924-5efdd8d11581): created successfully Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9ef83e-b9eb-448d-b750-e50a0abd9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:57 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Flow 'volume_create_manager' (4addcef2-3e23-4971-83f8-d0d9729d2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c3d1474b-a847-4c0d-86cb-7ca97d8c00c0 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created volume successfully. Jul 23 03:38:57 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 Jul 23 03:38:57 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 Jul 23 03:38:58 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-35390d62-7084-4ed4-b924-5efdd8d11581-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-35390d62-7084-4ed4-b924-5efdd8d11581-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:58 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa 1073741824" returned: 0 in 0.520s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-35390d62-7084-4ed4-b924-5efdd8d11581" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-35390d62-7084-4ed4-b924-5efdd8d11581" acquired by "delete_volume" :: waited 0.039s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:58 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa Jul 23 03:38:58 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f99dc4-e2f2-4262-97e0-6f2e8a122d0f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 Jul 23 03:38:58 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6" returned: 0 in 0.372s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6 Jul 23 03:38:58 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa" returned: 0 in 0.285s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a473d-7b70-4c27-82f8-012c1cc7d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6015667efb14ee984d42265f7ec38aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:55Z,use_quota=True,user_id='23e8f1cb944b4d20bff6fe4144f1c212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Creating volume 051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:58 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1073741824 Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8da9d11-89a1-456a-91af-00eff4758569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:58 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d72f9f2-c8f5-4d17-b4af-90b67c8df6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:58 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Volume volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa (4b6fed3d-3719-4e84-97a7-90c91dd936fa): created successfully Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d72f9f2-c8f5-4d17-b4af-90b67c8df6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Flow 'volume_create_manager' (2ef61ad6-134a-4f54-a153-6b2017ca9297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:58 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-26245dcd-4b57-44d3-8114-d524fd841210 tempest-ProjectReaderTests-1123937441 None] Created volume successfully. Jul 23 03:38:58 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581" returned: 0 in 0.387s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:58 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581 Jul 23 03:38:58 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:58 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7.8659ac6e-5830-402a-ac65-6a13c2827ed6" returned: 0 in 0.297s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-8659ac6e-5830-402a-ac65-6a13c2827ed6" released by "_delete_snapshot" :: held 1.574s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" released by "delete_snapshot" :: held 1.599s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Created reservations ['20c73bb2-76b5-45be-9935-bea83cabf207', 'ef1521aa-d1ca-4724-a983-6cfc391e5e44', '5e117f7b-2620-4acc-9de7-0550a9d74fb3', 'c299cb93-2a19-494f-92c6-e45d3b51aa08'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:58 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-d63fff0a-a4dc-4bee-9f70-33b24b5036f6 tempest-ProjectMemberTests-670957881 None] Lock "cinder-8659ac6e-5830-402a-ac65-6a13c2827ed6-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:58 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35390d62-7084-4ed4-b924-5efdd8d11581" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:58 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-35390d62-7084-4ed4-b924-5efdd8d11581" released by "delete_volume" :: held 0.744s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['5875b5c6-3c24-4bed-9722-67e027034754', '9ce5e4f9-abdf-414d-88e5-4e26a3938f55', '61710e67-d62f-462b-9107-b2c48a15f461', '5e65f134-8068-4c03-b2c2-d9f615ec9b92'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:59 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1073741824" returned: 0 in 0.526s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:59 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 Jul 23 03:38:59 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:38:59 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "cinder-4b6fed3d-3719-4e84-97a7-90c91dd936fa-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-10c0febb-98d7-4443-a1d7-1a648c2233d8-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-4b6fed3d-3719-4e84-97a7-90c91dd936fa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-10c0febb-98d7-4443-a1d7-1a648c2233d8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750" returned: 0 in 0.290s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "cinder-quobyte-4b6fed3d-3719-4e84-97a7-90c91dd936fa" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Attempting download of 1fe251d2-1db2-4d9f-80b8-44107240ea6f ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}])) to volume 051a473d-7b70-4c27-82f8-012c1cc7d750. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-10c0febb-98d7-4443-a1d7-1a648c2233d8" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-quobyte-4b6fed3d-3719-4e84-97a7-90c91dd936fa" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-285d7209-893a-4077-b13d-5249886d1ee7-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b089aad-94af-4b9b-bae1-3df2121ce15b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-10c0febb-98d7-4443-a1d7-1a648c2233d8" acquired by "delete_volume" :: waited 0.085s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb548a-f41b-4d8b-9e84-d69fb86c23ee]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "cinder-285d7209-893a-4077-b13d-5249886d1ee7-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb98065-2e5e-4ee1-bfd3-b03062cd609a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4bb44dc4-f913-472c-96da-44accad0da88 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-35390d62-7084-4ed4-b924-5efdd8d11581-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:59 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa Jul 23 03:38:59 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:59 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef77a228-640e-40cd-bb68-68216715cebd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 Jul 23 03:38:59 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 Jul 23 03:38:59 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:59 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa" returned: 0 in 0.435s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:59 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:59 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa Jul 23 03:39:00 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8" returned: 0 in 0.477s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8 Jul 23 03:39:00 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n Jul 23 03:39:00 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7" returned: 0 in 0.415s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7 Jul 23 03:39:00 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4b6fed3d-3719-4e84-97a7-90c91dd936fa" returned: 0 in 0.280s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-quobyte-4b6fed3d-3719-4e84-97a7-90c91dd936fa" released by "delete_volume" :: held 0.794s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Created reservations ['c4757b0f-2bf0-44c7-989c-f34f416f72f2', '7d226eca-1f3b-41a4-843e-1d57ba5594f8', '3fa4d778-4dc3-4e08-8d1f-4e9a65d7ab9f', '6eb2038c-c962-4dfd-8c9d-5c808a9244f8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:00 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-10c0febb-98d7-4443-a1d7-1a648c2233d8" returned: 0 in 0.284s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-10c0febb-98d7-4443-a1d7-1a648c2233d8" released by "delete_volume" :: held 0.838s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:00 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n" returned: 1 in 0.409s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe251d2-1db2-4d9f-80b8-44107240ea6f_90g8we4n' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ea6a8-bb72-4e19-90ce-76240d48a0f1]: (4, 'raw') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-285d7209-893a-4077-b13d-5249886d1ee7" returned: 0 in 0.329s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-285d7209-893a-4077-b13d-5249886d1ee7" released by "delete_volume" :: held 0.827s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['9d3c1cb9-940a-4460-8e38-99880670ecd9', '1050e2d3-3ba6-49f2-96d4-754889f4f2a4', '55dd9bc7-9e47-46a9-a0f4-ba3806fb0038', '81e21dcc-69f3-46ab-9995-55b92d3dbc85'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:00 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:39:00 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Created reservations ['bcc512aa-cfb3-46dd-9bce-b69ce8186621', '875d4876-5525-4138-966e-ee5f7da664a3', '351a85c5-24d6-4374-a69e-f4e5e32faad3', 'd646e685-7d81-47ca-8a75-81e6b7bd2166'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:00 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:00 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:00 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.370s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:00 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Deleted volume successfully. Jul 23 03:39:00 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:00 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-bf3ffcc7-c236-48ad-813c-3d135d4b6fb1 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-4b6fed3d-3719-4e84-97a7-90c91dd936fa-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:01 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD Jul 23 03:39:01 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:01 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:01 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.483s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.407s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:01 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-51756e0e-130d-40f5-8afd-afae873ebfa6 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-10c0febb-98d7-4443-a1d7-1a648c2233d8-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:01 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Flow 'volume_create_manager' (34a31725-63eb-4dfd-9745-a9ae90259fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e3334d-0646-426c-b3b7-7cf129ac83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e3334d-0646-426c-b3b7-7cf129ac83bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441071381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699d45a3-910c-4cb2-a5a2-bffb2188eba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ae26976624244b9259ba4b062381c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:01Z,use_quota=True,user_id='9f8c2009aa0a455b9790248b4a0addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff754579-7432-43ea-8af5-d753b681986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff754579-7432-43ea-8af5-d753b681986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69151abb-0ae7-4eda-895c-36858bc249ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69151abb-0ae7-4eda-895c-36858bc249ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699d45a3-910c-4cb2-a5a2-bffb2188eba5', 'volume_name': 'volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5e066c-ad60-4ed0-9e37-f4ee083da884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5e066c-ad60-4ed0-9e37-f4ee083da884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b786ca8-f3a7-4377-9654-1c6abb930793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:01 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Volume 699d45a3-910c-4cb2-a5a2-bffb2188eba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5', 'volume_size': 1} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441071381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699d45a3-910c-4cb2-a5a2-bffb2188eba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ae26976624244b9259ba4b062381c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:01Z,use_quota=True,user_id='9f8c2009aa0a455b9790248b4a0addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Creating volume 699d45a3-910c-4cb2-a5a2-bffb2188eba5 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:01 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-53022a6d-4484-4d6e-93a9-86d2deddab4f tempest-ProjectMemberTests-670957881 None] Lock "cinder-285d7209-893a-4077-b13d-5249886d1ee7-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:01 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] 1fe251d2-1db2-4d9f-80b8-44107240ea6f was raw, converting to qcow2 {{(pid=88044) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:39:01 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 1073741824 Jul 23 03:39:01 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:01 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 Jul 23 03:39:01 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-ab7d81c3-4b14-4adf-8a4f-d20553009733-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-ab7d81c3-4b14-4adf-8a4f-d20553009733-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-ab7d81c3-4b14-4adf-8a4f-d20553009733" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-ab7d81c3-4b14-4adf-8a4f-d20553009733" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e6b7b-aaa2-473c-a63e-0a7d85261246]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:01 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 1073741824" returned: 0 in 0.522s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:01 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 Jul 23 03:39:01 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:01 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750" returned: 0 in 0.559s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fe251d2-1db2-4d9f-80b8-44107240ea6f_z9m65b9vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:39:01 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:39:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:01 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 Jul 23 03:39:01 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:02 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1G Jul 23 03:39:02 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:02 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5" returned: 0 in 0.301s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:02 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733" returned: 0 in 0.462s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b786ca8-f3a7-4377-9654-1c6abb930793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733 Jul 23 03:39:02 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab38eef0-dfb4-4942-b4d8-17537e63d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Volume volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 (699d45a3-910c-4cb2-a5a2-bffb2188eba5): created successfully Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab38eef0-dfb4-4942-b4d8-17537e63d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Flow 'volume_create_manager' (34a31725-63eb-4dfd-9745-a9ae90259fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ddecc7a1-80a2-43b2-87a9-6721237a16d3 tempest-ProjectReaderTests-1123937441 None] Created volume successfully. Jul 23 03:39:02 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 1G" returned: 0 in 0.491s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Downloaded image 1fe251d2-1db2-4d9f-80b8-44107240ea6f ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}])) to volume 051a473d-7b70-4c27-82f8-012c1cc7d750 successfully. {{(pid=88044) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Temporary image 1fe251d2-1db2-4d9f-80b8-44107240ea6f for user 23e8f1cb944b4d20bff6fe4144f1c212 is deleted. {{(pid=88044) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.volume_utils [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Marking volume 051a473d-7b70-4c27-82f8-012c1cc7d750 as bootable. {{(pid=88044) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (aa945bdb-35c0-4022-b0ef-67021e6d5a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6f5d23-4556-49a2-8f99-25aded684fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Copying metadata from image 1fe251d2-1db2-4d9f-80b8-44107240ea6f to 051a473d-7b70-4c27-82f8-012c1cc7d750. {{(pid=88044) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Creating volume glance metadata for volume 051a473d-7b70-4c27-82f8-012c1cc7d750 backed by image 1fe251d2-1db2-4d9f-80b8-44107240ea6f with: {'image_id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '341a93f26dd625ef6c6f908bb54531e8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88044) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6f5d23-4556-49a2-8f99-25aded684fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062635197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38db5009-d08b-4884-88ad-fb5e4ee15626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:02Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0226e07-b235-4475-bcca-586624581d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0226e07-b235-4475-bcca-586624581d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef51f4-5bf7-4522-b208-c69d4873f8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef51f4-5bf7-4522-b208-c69d4873f8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38db5009-d08b-4884-88ad-fb5e4ee15626', 'volume_name': 'volume-38db5009-d08b-4884-88ad-fb5e4ee15626', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356d707a-d7e0-442f-9246-902daaf9783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356d707a-d7e0-442f-9246-902daaf9783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e47da4-a2df-4892-9e05-18667febd74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Volume 38db5009-d08b-4884-88ad-fb5e4ee15626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38db5009-d08b-4884-88ad-fb5e4ee15626', 'volume_size': 1} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062635197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38db5009-d08b-4884-88ad-fb5e4ee15626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:02Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Creating volume 38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-ab7d81c3-4b14-4adf-8a4f-d20553009733" returned: 0 in 0.316s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:02 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 1073741824 Jul 23 03:39:02 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-ab7d81c3-4b14-4adf-8a4f-d20553009733" released by "delete_volume" :: held 0.829s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f520082-28bb-4f89-ab10-50d773224506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051a473d-7b70-4c27-82f8-012c1cc7d750', 'volume_size': 1, 'image_id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341a93f26dd625ef6c6f908bb54531e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6015667efb14ee984d42265f7ec38aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42b9f689f734daa18be058da418e991efb07224d4918ea49ea30a73be900358623b44427294cf8208074d5b051a6845ba6f626d3110e0841377a106828171d1e', 'id': '1fe251d2-1db2-4d9f-80b8-44107240ea6f', 'created_at': datetime.datetime(2026, 7, 23, 1, 38, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 38, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe251d2-1db2-4d9f-80b8-44107240ea6f/file', 'properties': {}}, 'image_service': }' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1accaff-f904-4c69-a49e-fd52197b33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['12dde14f-4359-4fd1-b871-460c57f691d5', '0a0d319b-1039-49c5-aba8-228d64d94e47', 'e3373974-783b-4a14-84d4-4d10effeba3f', '2c5cea3f-6e40-43ae-8188-03cd43e3e701'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Volume volume-051a473d-7b70-4c27-82f8-012c1cc7d750 (051a473d-7b70-4c27-82f8-012c1cc7d750): created successfully Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1accaff-f904-4c69-a49e-fd52197b33c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Flow 'volume_create_manager' (5d467373-00c4-4860-b341-b0a0f343e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-984d580b-9827-4a63-95a5-ed9a0eb0ab79 tempest-VolumeImageDependencyTests-720619499 None] Created volume successfully. Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:02 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:02 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-d1704319-e345-4713-bf9c-fe1d4a233915-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-d1704319-e345-4713-bf9c-fe1d4a233915-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-d1704319-e345-4713-bf9c-fe1d4a233915" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:02 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-d1704319-e345-4713-bf9c-fe1d4a233915" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72a4ed-d7db-4ef3-9c70-687b514a9b1d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 1073741824" returned: 0 in 0.537s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:03 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 Jul 23 03:39:03 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-762db443-afdc-46f5-9d8a-0bf0a453364e tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-ab7d81c3-4b14-4adf-8a4f-d20553009733-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:03 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 Jul 23 03:39:03 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:03 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:03 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e47da4-a2df-4892-9e05-18667febd74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38db5009-d08b-4884-88ad-fb5e4ee15626', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c9f0b4-6f14-4b99-822c-f965ed93675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915" returned: 0 in 0.420s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Volume volume-38db5009-d08b-4884-88ad-fb5e4ee15626 (38db5009-d08b-4884-88ad-fb5e4ee15626): created successfully Jul 23 03:39:03 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915 Jul 23 03:39:03 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c9f0b4-6f14-4b99-822c-f965ed93675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (aa945bdb-35c0-4022-b0ef-67021e6d5a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "cinder-699d45a3-910c-4cb2-a5a2-bffb2188eba5-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:03 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ba733540-2177-4c47-b93e-653f15893fca tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Acquiring lock "cinder-051a473d-7b70-4c27-82f8-012c1cc7d750-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-699d45a3-910c-4cb2-a5a2-bffb2188eba5-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "cinder-051a473d-7b70-4c27-82f8-012c1cc7d750-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "cinder-quobyte-699d45a3-910c-4cb2-a5a2-bffb2188eba5" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-quobyte-699d45a3-910c-4cb2-a5a2-bffb2188eba5" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Acquiring lock "cinder-quobyte-051a473d-7b70-4c27-82f8-012c1cc7d750" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ec351-dbdb-4fe7-8add-f26ca508f6d7]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "cinder-quobyte-051a473d-7b70-4c27-82f8-012c1cc7d750" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:03 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d1704319-e345-4713-bf9c-fe1d4a233915" returned: 0 in 0.310s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb06349-bd56-4e47-bb07-6e361d6c44c0]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-d1704319-e345-4713-bf9c-fe1d4a233915" released by "delete_volume" :: held 0.782s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['509f4279-6dca-40ca-866d-4dd4a5747720', 'eab662ea-59fc-424e-abe1-e012c8c5abdd', '27962b95-03e2-42c3-9f90-7be2e899c3e5', 'c1dc75d1-3ff0-4e3e-8dd5-3c4097d812b8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:03 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 Jul 23 03:39:03 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:03 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 Jul 23 03:39:03 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:03 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:03 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-e6799e6d-2743-4844-9619-51bf2cb304ff-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-e6799e6d-2743-4844-9619-51bf2cb304ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-e6799e6d-2743-4844-9619-51bf2cb304ff" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:04 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5" returned: 0 in 0.451s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-e6799e6d-2743-4844-9619-51bf2cb304ff" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:04 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5 Jul 23 03:39:04 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750" returned: 0 in 0.444s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d74081-73b4-4248-9a07-868419f6a3bd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.322s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750 Jul 23 03:39:04 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:04 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-45d12e57-1b0f-4173-936e-5cbb760c0657 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-d1704319-e345-4713-bf9c-fe1d4a233915-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:04 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff Jul 23 03:39:04 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-699d45a3-910c-4cb2-a5a2-bffb2188eba5" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-quobyte-699d45a3-910c-4cb2-a5a2-bffb2188eba5" released by "delete_volume" :: held 0.780s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:04 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-051a473d-7b70-4c27-82f8-012c1cc7d750" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "cinder-quobyte-051a473d-7b70-4c27-82f8-012c1cc7d750" released by "delete_volume" :: held 0.802s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Created reservations ['92ca9fab-ea11-4844-ac1e-c5da36750a0f', 'f4c5c080-45b0-4f85-a970-07eac6a4f314', '00270add-96e9-4581-85b0-2d1aa8db11ff', '43ec7253-0f7a-4cb0-a607-7bb725c72ed1'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Created reservations ['297eaeb5-3d10-45cc-8173-2b9cbbd1d23a', 'da672409-c354-4bf1-984b-7708228212c2', '542b1b80-bf80-40a9-834d-39154f46ea3f', 'bc87f45a-34e9-40a5-b349-0f1948cfe805'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff" returned: 0 in 0.530s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:04 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff Jul 23 03:39:04 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Creating offline snapshot 47d1c879-466e-4f7c-b0f4-759565bdb099 of volume 38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39aef80-b578-4e42-85a8-4c3d01736565]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:05 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:05 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:05 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 Jul 23 03:39:05 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:05 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-e6799e6d-2743-4844-9619-51bf2cb304ff" returned: 0 in 0.359s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.445s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Deleted volume successfully. Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-e6799e6d-2743-4844-9619-51bf2cb304ff" released by "delete_volume" :: held 0.962s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0290693f-284f-4463-bc18-11bc7da12203 tempest-ProjectReaderTests-1123937441 None] Lock "cinder-699d45a3-910c-4cb2-a5a2-bffb2188eba5-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['7d2339f2-ccf5-4dac-a607-82a810ed4d76', 'c204e320-fd8e-4dcb-9f8f-77b73a68ec2a', 'fd10bc03-f73c-404b-a6df-965e06e58a8d', '63292fbc-5110-4d65-98d1-9b3c30336ed2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:05 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Deleted volume successfully. Jul 23 03:39:05 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:05 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=321,cinder:SELECT=226,cinder:INSERT=88,cinder:DELETE=27 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:39:05 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626" returned: 0 in 0.476s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6e868549-8799-4165-b9db-8cba32ef00b9 tempest-VolumeImageDependencyTests-720619499 None] Lock "cinder-051a473d-7b70-4c27-82f8-012c1cc7d750-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:05 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 1G Jul 23 03:39:05 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:05 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.283s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=243,cinder:UPDATE=317,cinder:DELETE=30,cinder:INSERT=82 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ff0893cd-404d-4eb4-84bb-f7d2a6ac2819 tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-e6799e6d-2743-4844-9619-51bf2cb304ff-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:05 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 1G" returned: 0 in 0.501s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38db5009-d08b-4884-88ad-fb5e4ee15626 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:05 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38db5009-d08b-4884-88ad-fb5e4ee15626 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 Jul 23 03:39:05 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:06 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38db5009-d08b-4884-88ad-fb5e4ee15626 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099" returned: 0 in 0.400s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:06 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 is being set with open permissions: ugo+rw Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:06 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 Jul 23 03:39:06 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-def157b0-d7b9-4530-9716-4a64bc4b247f-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-def157b0-d7b9-4530-9716-4a64bc4b247f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "cinder-quobyte-def157b0-d7b9-4530-9716-4a64bc4b247f" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-def157b0-d7b9-4530-9716-4a64bc4b247f" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af13811-b854-4f9f-98f0-2a4c3af782a5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:06 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:06 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f Jul 23 03:39:06 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:06 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info Jul 23 03:39:06 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:07 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f" returned: 0 in 0.506s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:07 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f Jul 23 03:39:07 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:07 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info" returned: 0 in 0.412s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:07 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info is being set with open permissions: ugo+rw Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:07 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info Jul 23 03:39:07 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:07 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-def157b0-d7b9-4530-9716-4a64bc4b247f" returned: 0 in 0.305s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-quobyte-def157b0-d7b9-4530-9716-4a64bc4b247f" released by "delete_volume" :: held 0.877s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Created reservations ['822fc678-570e-4585-9658-6027ec915e81', 'b84d118f-5895-4295-ac7a-ab1e376585f0', 'bfd2d6ef-07fd-4ea0-bc3c-c9e148f3b88c', 'f01cc680-1e9b-42b5-a474-3bf50a29b662'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:07 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.info" returned: 0 in 0.351s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-160d5545-c684-4d9d-93ea-d2a943ebdb0d tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:07 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:07 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:07 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Deleted volume successfully. Jul 23 03:39:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8a82f96f-46d8-4311-b79d-e39f0f0e414c tempest-CreateVolumesFromSourceVolumeTest-573390840 None] Lock "cinder-def157b0-d7b9-4530-9716-4a64bc4b247f-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-47d1c879-466e-4f7c-b0f4-759565bdb099-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-47d1c879-466e-4f7c-b0f4-759565bdb099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-47d1c879-466e-4f7c-b0f4-759565bdb099" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-47d1c879-466e-4f7c-b0f4-759565bdb099" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot 47d1c879-466e-4f7c-b0f4-759565bdb099 of volume 38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf33482-2de1-4b0f-bd12-962082f3778c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:08 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 Jul 23 03:39:08 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:08 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099" returned: 0 in 0.408s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38db5009-d08b-4884-88ad-fb5e4ee15626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a77dd-6b16-481c-95e9-b32ccce7fe66]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:08 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 Jul 23 03:39:08 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:09 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:09 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 Jul 23 03:39:09 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:09 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099" returned: 0 in 0.454s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:09 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099 Jul 23 03:39:09 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:09 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626.47d1c879-466e-4f7c-b0f4-759565bdb099" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-47d1c879-466e-4f7c-b0f4-759565bdb099" released by "_delete_snapshot" :: held 1.714s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" released by "delete_snapshot" :: held 1.744s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:09 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Created reservations ['8d7543a3-330b-4eec-b75e-05b917dbbf01', '5d14355a-bc51-43bc-bf06-0e143b63e70b', 'b5fa047d-66cf-4288-b216-b620c0a4727d', '2933455f-8fe4-493c-97b1-9168124992ed'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:09 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b470816-4edc-431c-ba77-cd3a2c2800e3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-47d1c879-466e-4f7c-b0f4-759565bdb099-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-38db5009-d08b-4884-88ad-fb5e4ee15626-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "cinder-38db5009-d08b-4884-88ad-fb5e4ee15626-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3477d99-99f4-4f8d-a8fd-556c2104d73f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:10 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 Jul 23 03:39:10 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:10 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626" returned: 0 in 0.475s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:10 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626 Jul 23 03:39:10 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:11 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-38db5009-d08b-4884-88ad-fb5e4ee15626" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-38db5009-d08b-4884-88ad-fb5e4ee15626" released by "delete_volume" :: held 0.893s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Created reservations ['4d56edf2-953b-40d2-9e38-9d37ebb17af7', '41b1f7be-9569-41d9-ad85-2a3a0cdd487b', 'c91cda31-d810-4136-ba56-c04114e6c3ce', '37a894ce-91de-4ac4-a361-c971004ef3c2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:11 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:11 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:11 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.344s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-998758e0-026a-4788-82b4-cd035789b04f tempest-ProjectMemberTests-670957881 None] Lock "cinder-38db5009-d08b-4884-88ad-fb5e4ee15626-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (10a30bb7-c1d6-4a11-9226-10a8a250e15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ada8eb-b807-4a44-bc1e-5c50523c82c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ada8eb-b807-4a44-bc1e-5c50523c82c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447378688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c66e21-74ad-401e-b94c-4b5b0a61f66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:12Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a9a89d-3a81-4b5b-ac95-5e71e2efaf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a9a89d-3a81-4b5b-ac95-5e71e2efaf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669c350f-67bc-47b0-9030-a9389891a887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669c350f-67bc-47b0-9030-a9389891a887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c66e21-74ad-401e-b94c-4b5b0a61f66d', 'volume_name': 'volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ad961-0dde-4f1f-b88e-f59e8129956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ad961-0dde-4f1f-b88e-f59e8129956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7bc118-2f67-4977-9913-5c23a8be3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:12 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Volume d3c66e21-74ad-401e-b94c-4b5b0a61f66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d', 'volume_size': 1} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447378688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c66e21-74ad-401e-b94c-4b5b0a61f66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:12Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Creating volume d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:12 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:12 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d 1073741824 Jul 23 03:39:12 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:12 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d 1073741824" returned: 0 in 0.493s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:12 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d Jul 23 03:39:12 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:13 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" returned: 0 in 0.437s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7bc118-2f67-4977-9913-5c23a8be3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfec6aa-8416-4ff3-b74d-4196a48ee463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Volume volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d (d3c66e21-74ad-401e-b94c-4b5b0a61f66d): created successfully Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfec6aa-8416-4ff3-b74d-4196a48ee463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (10a30bb7-c1d6-4a11-9226-10a8a250e15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-241e8d43-987a-484f-82df-7e23d50aaab1 tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Flow 'volume_create_manager' (dc546b3b-023b-4797-b33d-741e91187e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf1b0b-399e-4334-acd0-beff0b18449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf1b0b-399e-4334-acd0-beff0b18449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ba6c17-c193-4419-9f26-91d21e0660a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffa973d0d54414e94b6b9f71168bdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:13Z,use_quota=True,user_id='9195442409ab4d22949267bbcc021703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602a5658-b4f1-4c7a-a520-e99208cd9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602a5658-b4f1-4c7a-a520-e99208cd9d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb6047-4da6-4641-9e4f-d90fb40e45b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb6047-4da6-4641-9e4f-d90fb40e45b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ba6c17-c193-4419-9f26-91d21e0660a8', 'volume_name': 'volume-63ba6c17-c193-4419-9f26-91d21e0660a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3481f0-3109-47f1-865a-51b9f32f262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3481f0-3109-47f1-865a-51b9f32f262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484da150-3b87-4f37-a6fe-4b609eb79170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:13 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Volume 63ba6c17-c193-4419-9f26-91d21e0660a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ba6c17-c193-4419-9f26-91d21e0660a8', 'volume_size': 1} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ba6c17-c193-4419-9f26-91d21e0660a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffa973d0d54414e94b6b9f71168bdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:13Z,use_quota=True,user_id='9195442409ab4d22949267bbcc021703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Creating volume 63ba6c17-c193-4419-9f26-91d21e0660a8 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:13 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:13 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 1073741824 Jul 23 03:39:13 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:14 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 1073741824" returned: 0 in 0.613s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:14 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 Jul 23 03:39:14 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:14 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8" returned: 0 in 0.289s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.102s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484da150-3b87-4f37-a6fe-4b609eb79170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ba6c17-c193-4419-9f26-91d21e0660a8', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c90e100-7201-40c7-8544-222fcb78773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Creating offline snapshot d6d6bb49-e3ab-441b-abe1-209c8bf89d29 of volume d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:14 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Volume volume-63ba6c17-c193-4419-9f26-91d21e0660a8 (63ba6c17-c193-4419-9f26-91d21e0660a8): created successfully Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c90e100-7201-40c7-8544-222fcb78773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Flow 'volume_create_manager' (dc546b3b-023b-4797-b33d-741e91187e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950fe55-2fe6-4ffc-973c-c9279a75517a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-d6e65d3d-37b4-4a25-b531-298ce7727279 tempest-CinderUnicodeTest-948210823 None] Created volume successfully. Jul 23 03:39:14 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d Jul 23 03:39:14 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:14 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:14 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 1G Jul 23 03:39:14 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:15 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 1G" returned: 0 in 0.407s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:15 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 Jul 23 03:39:15 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:15 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:15 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 is being set with open permissions: ugo+rw Jul 23 03:39:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:15 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 Jul 23 03:39:15 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:16 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:16 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info Jul 23 03:39:16 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Flow 'volume_create_manager' (078c6160-89c9-4768-be35-a1e94b36fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546a8b7b-562c-4f43-ae05-8cc9be3de153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546a8b7b-562c-4f43-ae05-8cc9be3de153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605095459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4cdd68-1175-4280-b2e7-7252c586b066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffa973d0d54414e94b6b9f71168bdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:16Z,use_quota=True,user_id='9195442409ab4d22949267bbcc021703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8da8b7e-c473-4393-848b-8d22d57a08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8da8b7e-c473-4393-848b-8d22d57a08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c50b104-2a9e-42f5-ae7f-8af6fdd78baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c50b104-2a9e-42f5-ae7f-8af6fdd78baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4cdd68-1175-4280-b2e7-7252c586b066', 'volume_name': 'volume-4e4cdd68-1175-4280-b2e7-7252c586b066', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd0e17f-8f21-45a0-a816-ba8f6f4de3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd0e17f-8f21-45a0-a816-ba8f6f4de3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e65d2e-68c0-46e5-9563-cb80bf200cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Volume 4e4cdd68-1175-4280-b2e7-7252c586b066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4cdd68-1175-4280-b2e7-7252c586b066', 'volume_size': 1} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:16 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info" returned: 0 in 0.305s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:16 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info is being set with open permissions: ugo+rw Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:16 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info Jul 23 03:39:16 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:16 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.info" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605095459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4cdd68-1175-4280-b2e7-7252c586b066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffa973d0d54414e94b6b9f71168bdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:16Z,use_quota=True,user_id='9195442409ab4d22949267bbcc021703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Creating volume 4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:16 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:16 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 1073741824 Jul 23 03:39:16 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0bbda678-c738-4073-b193-7210b51f81fe tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:17 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 1073741824" returned: 0 in 0.487s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:17 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 Jul 23 03:39:17 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:17 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e65d2e-68c0-46e5-9563-cb80bf200cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4cdd68-1175-4280-b2e7-7252c586b066', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca96f82-8738-46b5-8ca5-7fc87e5eed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:17 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Volume volume-4e4cdd68-1175-4280-b2e7-7252c586b066 (4e4cdd68-1175-4280-b2e7-7252c586b066): created successfully Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca96f82-8738-46b5-8ca5-7fc87e5eed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Flow 'volume_create_manager' (078c6160-89c9-4768-be35-a1e94b36fff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-90037b5d-6924-4a62-9622-70872e952170 tempest-CinderUnicodeTest-948210823 None] Created volume successfully. Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-d6d6bb49-e3ab-441b-abe1-209c8bf89d29-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d6d6bb49-e3ab-441b-abe1-209c8bf89d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-d6d6bb49-e3ab-441b-abe1-209c8bf89d29" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d6d6bb49-e3ab-441b-abe1-209c8bf89d29" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot d6d6bb49-e3ab-441b-abe1-209c8bf89d29 of volume d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5015f-0430-40f1-a464-88ee8961452b]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:17 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 Jul 23 03:39:17 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:18 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29" returned: 0 in 0.383s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d3d2b-837f-4897-b258-422063aa2168]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:18 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d Jul 23 03:39:18 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Creating offline snapshot b8249d60-660d-4e25-af1d-46b0a3b346e2 of volume 4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:18 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" returned: 0 in 0.486s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb69fe4-5e10-41f8-ad60-4f348e97a261]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:18 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:18 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 Jul 23 03:39:18 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:18 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 Jul 23 03:39:18 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:18 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29" returned: 0 in 0.385s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:19 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29 Jul 23 03:39:19 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:19 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066" returned: 0 in 0.444s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:19 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 1G Jul 23 03:39:19 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:19 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d.d6d6bb49-e3ab-441b-abe1-209c8bf89d29" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d6d6bb49-e3ab-441b-abe1-209c8bf89d29" released by "_delete_snapshot" :: held 1.630s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" released by "delete_snapshot" :: held 1.652s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Created reservations ['85241aaa-c046-49cf-9b29-4a3e676ff512', '8e1bb987-eb5d-4f2e-a97c-57b442c03af4', '1eb402b7-b9ca-4b4b-8822-dbdbd5d8f726', 'bd4ec5a8-c752-4ea6-9c35-ea74c656321f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:19 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4cd6974a-750c-4211-a20b-6e8fc8f4dce5 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d6d6bb49-e3ab-441b-abe1-209c8bf89d29-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:19 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 1G" returned: 0 in 0.430s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4cdd68-1175-4280-b2e7-7252c586b066 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:19 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4cdd68-1175-4280-b2e7-7252c586b066 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 Jul 23 03:39:19 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-d3c66e21-74ad-401e-b94c-4b5b0a61f66d-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d3c66e21-74ad-401e-b94c-4b5b0a61f66d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:19 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4cdd68-1175-4280-b2e7-7252c586b066 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2" returned: 0 in 0.324s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:19 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 is being set with open permissions: ugo+rw Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:19 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 Jul 23 03:39:19 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610add7-3f37-46b3-bcb7-58048653aa10]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:19 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:20 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d Jul 23 03:39:20 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:20 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2" returned: 0 in 0.267s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:20 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info Jul 23 03:39:20 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:20 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" returned: 0 in 0.373s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d Jul 23 03:39:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:20 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info is being set with open permissions: ugo+rw Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:20 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info Jul 23 03:39:20 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:20 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" returned: 0 in 0.250s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-d3c66e21-74ad-401e-b94c-4b5b0a61f66d" released by "delete_volume" :: held 0.690s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Created reservations ['dbfcac10-9487-45ee-a4c6-904d2b4fc11c', '1ce32066-0fc9-4aa7-a011-18c85f532e2b', '6f36140b-372a-4bf7-b1b5-ada3f79ae802', 'dbc0f618-f064-4ab8-8d61-b291faed9df3'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:20 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.info" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-16b13190-e542-4548-8abe-c00652fdba6d tempest-CinderUnicodeTest-948210823 None] Create snapshot completed successfully Jul 23 03:39:20 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:20 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:20 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.245s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:20 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:20 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-76313f39-6724-46ae-98e6-e439b2a656f3 tempest-ProjectMemberTests-670957881 None] Lock "cinder-d3c66e21-74ad-401e-b94c-4b5b0a61f66d-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (412275aa-97dd-44df-90d7-1ca15d01f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255fc852-a9c3-447d-99f8-eb76ede85093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255fc852-a9c3-447d-99f8-eb76ede85093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133700856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a1b53f-e004-4f0b-814a-d7fb23b07a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:21Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840227f2-4dae-4784-acef-55235b17dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840227f2-4dae-4784-acef-55235b17dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510520bb-ebd8-47b1-b54e-7857deba69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510520bb-ebd8-47b1-b54e-7857deba69de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a1b53f-e004-4f0b-814a-d7fb23b07a18', 'volume_name': 'volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6252bb6c-b0ee-44d3-a5f7-0bcea20fea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6252bb6c-b0ee-44d3-a5f7-0bcea20fea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4174cd71-8570-4f37-93f0-9304c05960b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:21 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Volume b2a1b53f-e004-4f0b-814a-d7fb23b07a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18', 'volume_size': 1} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133700856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a1b53f-e004-4f0b-814a-d7fb23b07a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:21Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Creating volume b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:21 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:21 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 1073741824 Jul 23 03:39:21 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-b8249d60-660d-4e25-af1d-46b0a3b346e2-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-b8249d60-660d-4e25-af1d-46b0a3b346e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-quobyte-b8249d60-660d-4e25-af1d-46b0a3b346e2" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-b8249d60-660d-4e25-af1d-46b0a3b346e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Deleting offline snapshot b8249d60-660d-4e25-af1d-46b0a3b346e2 of volume 4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] snapshot_file for this snap is: volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7e125-b8f9-457c-a7fa-393f0cdeb91f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:21 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 1073741824" returned: 0 in 0.470s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:21 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 Jul 23 03:39:21 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:21 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:21 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 Jul 23 03:39:21 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:22 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:22 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2" returned: 0 in 0.391s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4cdd68-1175-4280-b2e7-7252c586b066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4174cd71-8570-4f37-93f0-9304c05960b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e42d2e5-71f9-4345-8331-c6429f442f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[55890322-5f34-49c9-aa1b-421dfdbe0650]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:22 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Volume volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 (b2a1b53f-e004-4f0b-814a-d7fb23b07a18): created successfully Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e42d2e5-71f9-4345-8331-c6429f442f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (412275aa-97dd-44df-90d7-1ca15d01f133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:22 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5ea11490-8f67-4622-a976-f17b549ae503 tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:22 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 Jul 23 03:39:22 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot 743bb5ad-df16-41bb-b478-fcc5724d0dd0 of volume b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff39bc5-60dc-46f4-9468-ccfffaad9fd8]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:22 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066" returned: 0 in 0.388s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:22 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 Jul 23 03:39:22 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:22 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 Jul 23 03:39:22 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:22 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:22 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 1G Jul 23 03:39:22 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:22 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2" returned: 0 in 0.354s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:22 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:23 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2 Jul 23 03:39:23 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:23 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066.b8249d60-660d-4e25-af1d-46b0a3b346e2" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-b8249d60-660d-4e25-af1d-46b0a3b346e2" released by "_delete_snapshot" :: held 1.512s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" released by "delete_snapshot" :: held 1.539s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:23 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 1G" returned: 0 in 0.398s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:23 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 Jul 23 03:39:23 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Created reservations ['c9c81eac-af37-466f-8485-fbdf0a84a22c', '5a50044c-d630-4ed0-81e0-172bda020307', '5338252b-199a-4795-baaa-f3f294708e16', 'bd1a6852-5d84-4344-93e6-0a7862fafce9'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:23 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Delete snapshot completed successfully. Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e2c09bf6-426e-4448-addb-336a0fb4957f tempest-CinderUnicodeTest-948210823 None] Lock "cinder-b8249d60-660d-4e25-af1d-46b0a3b346e2-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:23 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0" returned: 0 in 0.293s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:23 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 is being set with open permissions: ugo+rw Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:23 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 Jul 23 03:39:23 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:23 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0" returned: 0 in 0.278s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-4e4cdd68-1175-4280-b2e7-7252c586b066-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-4e4cdd68-1175-4280-b2e7-7252c586b066-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:23 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info Jul 23 03:39:23 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:23 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fe657a-7e7c-4968-9147-e21def6e0344]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:24 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 Jul 23 03:39:24 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:24 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info" returned: 0 in 0.257s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:24 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info is being set with open permissions: ugo+rw Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:24 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info Jul 23 03:39:24 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:24 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066" returned: 0 in 0.375s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:24 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066 Jul 23 03:39:24 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:24 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.info" returned: 0 in 0.263s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b2d6fb09-460d-4614-89c4-3cd910b30e89 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-743bb5ad-df16-41bb-b478-fcc5724d0dd0-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-743bb5ad-df16-41bb-b478-fcc5724d0dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:24 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-4e4cdd68-1175-4280-b2e7-7252c586b066" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-743bb5ad-df16-41bb-b478-fcc5724d0dd0" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-4e4cdd68-1175-4280-b2e7-7252c586b066" released by "delete_volume" :: held 0.708s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-743bb5ad-df16-41bb-b478-fcc5724d0dd0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot 743bb5ad-df16-41bb-b478-fcc5724d0dd0 of volume b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[90093c47-d68e-4a8d-b5c2-56bc434e73b5]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Created reservations ['393f55db-41ba-4e88-ae67-e26268d1b005', '14ecca32-48da-41b4-b34b-3689c88e379e', 'face22d3-93e0-4a3d-b8b5-6de89c795b04', '1bb0c6cf-979e-4a59-ab1b-2c5650dbb66f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:24 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:24 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 Jul 23 03:39:24 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:24 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:24 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-63ba6c17-c193-4419-9f26-91d21e0660a8-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-63ba6c17-c193-4419-9f26-91d21e0660a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:25 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.295s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "cinder-quobyte-63ba6c17-c193-4419-9f26-91d21e0660a8" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:25 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Deleted volume successfully. Jul 23 03:39:25 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-63ba6c17-c193-4419-9f26-91d21e0660a8" acquired by "delete_volume" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0" returned: 0 in 0.456s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ef8c0-74ec-4417-a710-b209d0eadb0a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa04868-cb05-49da-ae7e-cb56d45c6388]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-6714e676-b3d1-43b7-8389-b096f1734fb5 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-4e4cdd68-1175-4280-b2e7-7252c586b066-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:25 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 Jul 23 03:39:25 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:25 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 Jul 23 03:39:25 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:25 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8" returned: 0 in 0.376s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:25 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" returned: 0 in 0.376s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:25 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8 Jul 23 03:39:25 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:25 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 Jul 23 03:39:25 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:25 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-63ba6c17-c193-4419-9f26-91d21e0660a8" returned: 0 in 0.264s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-quobyte-63ba6c17-c193-4419-9f26-91d21e0660a8" released by "delete_volume" :: held 0.691s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:25 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Created reservations ['3f9c3acf-70fd-4077-9e94-61d53ae4eed1', '92034b7a-89ef-4926-8bf5-1df8f063d2c4', '066ac0f4-1ee6-4d1e-be09-dd1e9960c95f', '2996000e-a1a7-437f-b7a9-a773d50d4fbe'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:25 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0" returned: 0 in 0.372s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:26 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0 Jul 23 03:39:26 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:26 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:26 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:26 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18.743bb5ad-df16-41bb-b478-fcc5724d0dd0" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:26 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.272s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-743bb5ad-df16-41bb-b478-fcc5724d0dd0" released by "_delete_snapshot" :: held 1.583s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Deleted volume successfully. Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" released by "delete_snapshot" :: held 1.618s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5bdd8466-b27a-47e9-98a6-8c9f2053ebd6 tempest-CinderUnicodeTest-948210823 None] Lock "cinder-63ba6c17-c193-4419-9f26-91d21e0660a8-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Created reservations ['39920495-9f32-462f-9ad1-438201752677', '70a4dfaa-1f3e-4a51-9b4a-e374c6bd97ad', '7dfd64c1-47e3-4c54-9eab-ca49d303c213', '307cb258-439e-4ce5-9ccd-b3c587e8e19e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:26 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ed663148-4794-4b81-a92f-765974e8dc86 tempest-ProjectMemberTests-670957881 None] Lock "cinder-743bb5ad-df16-41bb-b478-fcc5724d0dd0-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-b2a1b53f-e004-4f0b-814a-d7fb23b07a18-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "cinder-b2a1b53f-e004-4f0b-814a-d7fb23b07a18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" acquired by "delete_volume" :: waited 0.030s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a78da-599d-4d59-9822-efae5e694fcf]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:26 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:27 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 Jul 23 03:39:27 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:27 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:27 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18 Jul 23 03:39:27 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:27 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-b2a1b53f-e004-4f0b-814a-d7fb23b07a18" released by "delete_volume" :: held 0.751s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Created reservations ['df2d5d3b-2f9d-4165-831a-a5ccc91b4ffd', '7c148adf-09fb-4d32-8851-92a148aab94d', '3cceae99-0db0-49c3-a8a6-d7eec4ca0d02', '4076f3c9-21bb-4164-9b53-d5633c753b54'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:27 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:27 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:27 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:28 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:28 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5a53e782-4525-4121-b773-fc1363fc39de tempest-ProjectMemberTests-670957881 None] Lock "cinder-b2a1b53f-e004-4f0b-814a-d7fb23b07a18-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (f5e1e257-aeb5-456a-bb78-df52f80f5993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05409595-3d2a-454b-ae47-8530a8b33a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05409595-3d2a-454b-ae47-8530a8b33a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510754370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35803386-4fb1-4873-886b-b2c9cc73ff89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:28Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a580c2-7c09-4ff9-b77f-35ecd60dba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a580c2-7c09-4ff9-b77f-35ecd60dba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e9531e-84e1-4542-bbbe-a2791b5bd634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e9531e-84e1-4542-bbbe-a2791b5bd634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35803386-4fb1-4873-886b-b2c9cc73ff89', 'volume_name': 'volume-35803386-4fb1-4873-886b-b2c9cc73ff89', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f44735e-3070-4331-8e1e-8d6d3c147ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f44735e-3070-4331-8e1e-8d6d3c147ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ab2226-3357-4d5c-be31-4cc248e64504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:28 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Volume 35803386-4fb1-4873-886b-b2c9cc73ff89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35803386-4fb1-4873-886b-b2c9cc73ff89', 'volume_size': 1} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510754370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35803386-4fb1-4873-886b-b2c9cc73ff89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:28Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Creating volume 35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:28 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:28 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:28 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 1073741824 Jul 23 03:39:28 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:29 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 1073741824" returned: 0 in 0.479s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:29 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 Jul 23 03:39:29 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:29 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ab2226-3357-4d5c-be31-4cc248e64504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35803386-4fb1-4873-886b-b2c9cc73ff89', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9b7ae7-4fba-4e56-b7b7-5a3ce3617e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:29 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Volume volume-35803386-4fb1-4873-886b-b2c9cc73ff89 (35803386-4fb1-4873-886b-b2c9cc73ff89): created successfully Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9b7ae7-4fba-4e56-b7b7-5a3ce3617e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:29 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (f5e1e257-aeb5-456a-bb78-df52f80f5993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:29 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8500afc3-2492-4e68-a2c2-083b77524c1c tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:30 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot f206b1b7-4187-44ee-a09d-cc382740ff6d of volume 35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:30 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab97d27-44a9-4b11-b55d-27696fc59c8a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:30 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:30 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 Jul 23 03:39:30 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:31 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89" returned: 0 in 0.406s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:31 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d 1G Jul 23 03:39:31 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:31 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d 1G" returned: 0 in 0.469s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:31 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35803386-4fb1-4873-886b-b2c9cc73ff89 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:31 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35803386-4fb1-4873-886b-b2c9cc73ff89 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d Jul 23 03:39:31 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:32 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35803386-4fb1-4873-886b-b2c9cc73ff89 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d" returned: 0 in 0.337s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:32 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d is being set with open permissions: ugo+rw Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:32 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d Jul 23 03:39:32 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:32 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d" returned: 0 in 0.269s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:32 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info Jul 23 03:39:32 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:32 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:32 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info is being set with open permissions: ugo+rw Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:32 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info Jul 23 03:39:32 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:32 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.info" returned: 0 in 0.258s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:32 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:32 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-efacc8be-3bc6-4011-b99c-f256ff24c8d7 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-f206b1b7-4187-44ee-a09d-cc382740ff6d-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-f206b1b7-4187-44ee-a09d-cc382740ff6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:33 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-f206b1b7-4187-44ee-a09d-cc382740ff6d" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-f206b1b7-4187-44ee-a09d-cc382740ff6d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot f206b1b7-4187-44ee-a09d-cc382740ff6d of volume 35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c7559-575d-4d3b-bc19-c5893b9115b0]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:34 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d Jul 23 03:39:34 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (6aa068fb-d0c1-4805-8f82-fc9021c38c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef283da-0cb2-4d1b-b1cc-ac48b2df4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef283da-0cb2-4d1b-b1cc-ac48b2df4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1559436554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6485362-77d3-45c9-81da-9701256053b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:34Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ddab98-ee50-4dfb-8fb2-b2152491b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ddab98-ee50-4dfb-8fb2-b2152491b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb686ffa-f0dd-4e74-98a4-683f8f28b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb686ffa-f0dd-4e74-98a4-683f8f28b60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6485362-77d3-45c9-81da-9701256053b5', 'volume_name': 'volume-a6485362-77d3-45c9-81da-9701256053b5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a204d-aca8-4e7a-960d-2f082fa4d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a204d-aca8-4e7a-960d-2f082fa4d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39769fde-4c9c-43b8-ab6d-92b33cd5f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:34 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Volume a6485362-77d3-45c9-81da-9701256053b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6485362-77d3-45c9-81da-9701256053b5', 'volume_size': 1} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1559436554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6485362-77d3-45c9-81da-9701256053b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:34Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Creating volume a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:34 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:34 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 1073741824 Jul 23 03:39:34 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:34 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d" returned: 0 in 0.395s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35803386-4fb1-4873-886b-b2c9cc73ff89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9406dda-362d-487b-b519-830a31c779c3]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:34 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 Jul 23 03:39:34 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:34 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 1073741824" returned: 0 in 0.436s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:34 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 Jul 23 03:39:34 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:34 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89" returned: 0 in 0.398s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:34 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:34 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d Jul 23 03:39:34 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:35 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39769fde-4c9c-43b8-ab6d-92b33cd5f174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6485362-77d3-45c9-81da-9701256053b5', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c858acb-180e-42d0-8023-26f6d92967f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:35 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Volume volume-a6485362-77d3-45c9-81da-9701256053b5 (a6485362-77d3-45c9-81da-9701256053b5): created successfully Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c858acb-180e-42d0-8023-26f6d92967f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (6aa068fb-d0c1-4805-8f82-fc9021c38c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8166bac1-34c9-458a-88b2-f2f0d41f66ba tempest-ProjectReaderTests-354028170 None] Created volume successfully. Jul 23 03:39:35 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d" returned: 0 in 0.360s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:35 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d Jul 23 03:39:35 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Creating offline snapshot 7aede91f-0758-4aa2-813a-58a429485a9e of volume a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[14616229-4bc1-473f-9efd-23381455a761]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:35 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89.f206b1b7-4187-44ee-a09d-cc382740ff6d" returned: 0 in 0.279s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-f206b1b7-4187-44ee-a09d-cc382740ff6d" released by "_delete_snapshot" :: held 1.527s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" released by "delete_snapshot" :: held 1.548s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Created reservations ['e757bcd0-0113-4205-b512-c9a7499a9e45', '49aa104b-173e-48f4-bd83-bad55fa4b519', '365ca58b-e985-492e-b68f-1e59bffc20db', 'b8fe8364-98ce-4a05-8a75-de6657dd94ca'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:35 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 Jul 23 03:39:35 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:35 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e6cdd3ea-5d89-472b-bb60-ae77c29c11a4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-f206b1b7-4187-44ee-a09d-cc382740ff6d-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:35 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:35 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:35 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:35 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e 1G Jul 23 03:39:35 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-35803386-4fb1-4873-886b-b2c9cc73ff89-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:36 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.268s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-35803386-4fb1-4873-886b-b2c9cc73ff89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 29 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f0c66-4cf7-41bc-a2a3-350f2b758963]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:36 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e 1G" returned: 0 in 0.447s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6485362-77d3-45c9-81da-9701256053b5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:36 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6485362-77d3-45c9-81da-9701256053b5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e Jul 23 03:39:36 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 Jul 23 03:39:36 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:36 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6485362-77d3-45c9-81da-9701256053b5 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e" returned: 0 in 0.296s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e is being set with open permissions: ugo+rw Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:36 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89 Jul 23 03:39:36 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e Jul 23 03:39:36 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-35803386-4fb1-4873-886b-b2c9cc73ff89" returned: 0 in 0.264s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e" returned: 0 in 0.267s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-35803386-4fb1-4873-886b-b2c9cc73ff89" released by "delete_volume" :: held 0.700s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:36 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info Jul 23 03:39:36 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:36 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Created reservations ['c47dc923-367c-47cc-b606-32656952e56d', '251b9ba5-cc9e-4317-b05d-358b405456e1', '178de8c8-6424-4ec3-910a-a8e433863ee4', '633b63fc-f347-4822-a783-6abc4a682cf8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:37 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:37 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:37 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info" returned: 0 in 0.274s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:37 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info is being set with open permissions: ugo+rw Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:37 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info Jul 23 03:39:37 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:37 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.271s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-c6bae18b-adc6-424e-bcae-8f5e7ecbe4e4 tempest-ProjectMemberTests-670957881 None] Lock "cinder-35803386-4fb1-4873-886b-b2c9cc73ff89-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:37 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.info" returned: 0 in 0.258s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:37 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:37 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1040eb75-479b-4631-b44a-2f8095879468 tempest-ProjectReaderTests-354028170 None] Create snapshot completed successfully Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (38de8334-4b40-445d-976f-be7f0bf1c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b2e7ce-e85c-42e0-9849-0af939aad07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b2e7ce-e85c-42e0-9849-0af939aad07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189966599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9e770f-1a54-48fe-8a23-d96696d47415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:38Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448d29d9-c2f1-4676-b19f-c1da5ca3e377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448d29d9-c2f1-4676-b19f-c1da5ca3e377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b83a4-de32-4879-92c8-002229484fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b83a4-de32-4879-92c8-002229484fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9e770f-1a54-48fe-8a23-d96696d47415', 'volume_name': 'volume-fc9e770f-1a54-48fe-8a23-d96696d47415', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d8ad0-0969-4fce-90cd-a328cfb63dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d8ad0-0969-4fce-90cd-a328cfb63dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da7dd0-5119-407c-bda8-4ee692d03870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Volume fc9e770f-1a54-48fe-8a23-d96696d47415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9e770f-1a54-48fe-8a23-d96696d47415', 'volume_size': 1} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189966599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9e770f-1a54-48fe-8a23-d96696d47415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:38Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Creating volume fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:38 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:38 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 1073741824 Jul 23 03:39:38 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:38 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 1073741824" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:38 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 Jul 23 03:39:38 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-7aede91f-0758-4aa2-813a-58a429485a9e-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-7aede91f-0758-4aa2-813a-58a429485a9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-7aede91f-0758-4aa2-813a-58a429485a9e" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7aede91f-0758-4aa2-813a-58a429485a9e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Deleting offline snapshot 7aede91f-0758-4aa2-813a-58a429485a9e of volume a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:38 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] snapshot_file for this snap is: volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415" returned: 0 in 0.273s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da7dd0-5119-407c-bda8-4ee692d03870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9e770f-1a54-48fe-8a23-d96696d47415', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cf0480-68dc-40be-b385-ff21c6adfbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e398619-f239-4588-b8fc-a9d8d123fe2a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:38 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Volume volume-fc9e770f-1a54-48fe-8a23-d96696d47415 (fc9e770f-1a54-48fe-8a23-d96696d47415): created successfully Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cf0480-68dc-40be-b385-ff21c6adfbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:38 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (38de8334-4b40-445d-976f-be7f0bf1c755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:38 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-1405e818-1404-49d2-b385-c5d0710942a5 tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:38 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e Jul 23 03:39:38 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 of volume fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d99cc-b67b-4abe-8f4d-e4c748ed4a05]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:39 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e" returned: 0 in 0.410s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6485362-77d3-45c9-81da-9701256053b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[14984ab5-3145-4fc6-9023-981a161cacc1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:39 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 Jul 23 03:39:39 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:39 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 Jul 23 03:39:39 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:39 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415" returned: 0 in 0.376s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:39 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 1G Jul 23 03:39:39 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5" returned: 0 in 0.373s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:39 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:39 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e Jul 23 03:39:39 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 1G" returned: 0 in 0.425s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9e770f-1a54-48fe-8a23-d96696d47415 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e" returned: 0 in 0.389s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:40 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9e770f-1a54-48fe-8a23-d96696d47415 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 Jul 23 03:39:40 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e Jul 23 03:39:40 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5.7aede91f-0758-4aa2-813a-58a429485a9e" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7aede91f-0758-4aa2-813a-58a429485a9e" released by "_delete_snapshot" :: held 1.535s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:40 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9e770f-1a54-48fe-8a23-d96696d47415 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" returned: 0 in 0.307s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 is being set with open permissions: ugo+rw Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" released by "delete_snapshot" :: held 1.569s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:40 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 Jul 23 03:39:40 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Created reservations ['ab315567-fc22-4c60-9ad2-e74180162784', '8b7cf5a1-a123-42cc-9558-5e7689c6843d', 'ab8f9cc2-9572-4c2f-b613-4c96a9104112', '4ccf9fa4-304e-45d1-a84c-d2cbf208a61b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:40 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Delete snapshot completed successfully. Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-3398a28a-5155-4248-97af-d4c205817d92 tempest-ProjectReaderTests-354028170 None] Lock "cinder-7aede91f-0758-4aa2-813a-58a429485a9e-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:40 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" returned: 0 in 0.257s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:40 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info Jul 23 03:39:40 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info" returned: 0 in 0.263s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:40 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info is being set with open permissions: ugo+rw Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:40 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info Jul 23 03:39:40 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-a6485362-77d3-45c9-81da-9701256053b5-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "cinder-a6485362-77d3-45c9-81da-9701256053b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:40 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b09420-167c-45e6-9b8d-cfe94da5cd95]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:41 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 Jul 23 03:39:41 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:41 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.info" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-6650c40c-7625-4257-b84f-ca3226241c13 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 of volume fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:41 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5" returned: 0 in 0.413s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05cd2f2-ec45-46b8-8bac-48fe4d59c0e9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:41 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5 Jul 23 03:39:41 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:41 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 Jul 23 03:39:41 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:41 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-a6485362-77d3-45c9-81da-9701256053b5" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-a6485362-77d3-45c9-81da-9701256053b5" released by "delete_volume" :: held 0.732s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Created reservations ['d3500ee3-2f4c-4000-aeb6-53116a608057', '0ba68472-61d9-45da-8fde-763fa19e9662', '7a2173e1-8858-4d9f-a551-26d797373d16', '73d696ce-9e26-4edb-bf75-f62986edc77a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:41 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc9e770f-1a54-48fe-8a23-d96696d47415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:41 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:41 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4db298-4387-458b-8522-e16204a089dd]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:42 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 Jul 23 03:39:42 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:42 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:42 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Deleted volume successfully. Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2d3886b7-ae8c-43df-8c89-d3a2e7fa538d tempest-ProjectReaderTests-354028170 None] Lock "cinder-a6485362-77d3-45c9-81da-9701256053b5-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:42 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415" returned: 0 in 0.392s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:42 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 Jul 23 03:39:42 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (41045e6e-25e9-4f41-a1c0-6d02995509bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9743d117-7889-480d-bb2a-9f29ca019708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9743d117-7889-480d-bb2a-9f29ca019708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823253264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095762a1-c2c4-49b5-93f5-10ad64907d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:43Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf4f79-a263-444f-a409-bd5822a1e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf4f79-a263-444f-a409-bd5822a1e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce92e25-a5fe-4d46-82fa-9ed398a963c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:42 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce92e25-a5fe-4d46-82fa-9ed398a963c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095762a1-c2c4-49b5-93f5-10ad64907d22', 'volume_name': 'volume-095762a1-c2c4-49b5-93f5-10ad64907d22', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c864894-98c8-4648-9ede-6e891aa23870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c864894-98c8-4648-9ede-6e891aa23870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a77c13-b83f-4572-ae9c-452076fa3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:42 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Volume 095762a1-c2c4-49b5-93f5-10ad64907d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095762a1-c2c4-49b5-93f5-10ad64907d22', 'volume_size': 1} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823253264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095762a1-c2c4-49b5-93f5-10ad64907d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:43Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Creating volume 095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:42 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" returned: 0 in 0.455s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:42 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 1073741824 Jul 23 03:39:42 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:42 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5 Jul 23 03:39:42 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:42 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415.ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5" released by "_delete_snapshot" :: held 1.597s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" released by "delete_snapshot" :: held 1.623s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Created reservations ['e58be933-c7db-433c-8e0f-1bc7e7c2f956', '4ff9acc7-69ff-4c6d-8f4a-aec78858570a', '749e5aa9-25bc-4607-b1f4-f25843977cb9', '2ef134b3-184c-45e2-8705-1473f541fe2a'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-5288a7e5-758f-4663-b111-fbad14defbbd tempest-ProjectMemberTests-670957881 None] Lock "cinder-ee970ea7-eb3e-41a6-a0ab-69b02f8963b5-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:43 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 1073741824" returned: 0 in 0.451s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:43 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 Jul 23 03:39:43 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:43 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22" returned: 0 in 0.243s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a77c13-b83f-4572-ae9c-452076fa3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095762a1-c2c4-49b5-93f5-10ad64907d22', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38e052-8fd7-47de-bfe5-a501ecb66dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:43 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Volume volume-095762a1-c2c4-49b5-93f5-10ad64907d22 (095762a1-c2c4-49b5-93f5-10ad64907d22): created successfully Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38e052-8fd7-47de-bfe5-a501ecb66dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (41045e6e-25e9-4f41-a1c0-6d02995509bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e574b35d-d991-4828-b15f-d7ef8039356a tempest-ProjectReaderTests-354028170 None] Created volume successfully. Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-fc9e770f-1a54-48fe-8a23-d96696d47415-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "cinder-fc9e770f-1a54-48fe-8a23-d96696d47415-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c9c356-4910-4740-9029-c9b0dc0d76c9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:43 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 Jul 23 03:39:43 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:44 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415" returned: 0 in 0.371s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:44 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415 Jul 23 03:39:44 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:44 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-fc9e770f-1a54-48fe-8a23-d96696d47415" returned: 0 in 0.242s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-fc9e770f-1a54-48fe-8a23-d96696d47415" released by "delete_volume" :: held 0.668s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Created reservations ['2ad1f62c-66a6-4c47-9f9b-cf2784720182', 'c6fcb741-d3c2-4a37-bb82-2aa3ea848d5c', '1e25d4b3-4eac-4677-8c26-51d152011c02', '6d3f31a4-014e-422f-b90a-3f8323caf926'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:44 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:44 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:44 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.256s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:44 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-11f1027e-457f-41a2-950e-869ad96c57b0 tempest-ProjectMemberTests-670957881 None] Lock "cinder-fc9e770f-1a54-48fe-8a23-d96696d47415-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Creating offline snapshot 7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 of volume 095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[690eea47-1704-4aae-82b0-baf1e3faec97]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:44 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 Jul 23 03:39:44 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (926d96d2-338a-4fce-998e-af50de9f8231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8860241e-3c0d-44a7-8d92-5cd829407e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8860241e-3c0d-44a7-8d92-5cd829407e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581080398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e630df-9dc9-4bc6-9e59-0f649c7272ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:45Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:45 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4000d0-eab2-4f20-b2af-986627603208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4000d0-eab2-4f20-b2af-986627603208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0818573-fdf2-4813-ac92-fba46477d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0818573-fdf2-4813-ac92-fba46477d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e630df-9dc9-4bc6-9e59-0f649c7272ef', 'volume_name': 'volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d79016f-930a-4459-969a-935dc1708a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d79016f-930a-4459-969a-935dc1708a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2177cc6-95ac-4b05-bd50-665fefcb8935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:45 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Volume 45e630df-9dc9-4bc6-9e59-0f649c7272ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef', 'volume_size': 1} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22" returned: 0 in 0.411s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:45 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 1G Jul 23 03:39:45 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:45 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 1G" returned: 0 in 0.408s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095762a1-c2c4-49b5-93f5-10ad64907d22 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:45 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095762a1-c2c4-49b5-93f5-10ad64907d22 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 Jul 23 03:39:45 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:45 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095762a1-c2c4-49b5-93f5-10ad64907d22 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:45 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 is being set with open permissions: ugo+rw Jul 23 03:39:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:46 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 Jul 23 03:39:46 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:46 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" returned: 0 in 0.244s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:46 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info Jul 23 03:39:46 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:46 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info" returned: 0 in 0.243s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:46 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info is being set with open permissions: ugo+rw Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:46 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info Jul 23 03:39:46 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:46 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.info" returned: 0 in 0.243s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581080398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e630df-9dc9-4bc6-9e59-0f649c7272ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d8eea6747445db0ec7952a5fef1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:45Z,use_quota=True,user_id='2dbbdc766c6b4a149ce77e37d44916a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Creating volume 45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:46 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:46 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef 1073741824 Jul 23 03:39:46 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:46 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2befccef-7df7-429c-8994-a723a35d49a3 tempest-ProjectReaderTests-354028170 None] Create snapshot completed successfully Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:46 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Deleting offline snapshot 7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 of volume 095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] snapshot_file for this snap is: volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac87adf2-46a4-4441-812f-0598ea111346]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:47 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 Jul 23 03:39:47 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:47 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef 1073741824" returned: 0 in 0.449s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:47 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef Jul 23 03:39:47 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:47 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" returned: 0 in 0.394s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095762a1-c2c4-49b5-93f5-10ad64907d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[855b381f-0207-4c1e-9d41-41eef2848dff]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:47 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef" returned: 0 in 0.250s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2177cc6-95ac-4b05-bd50-665fefcb8935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c095a74-e1b3-48d3-83ce-f661cf5176cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:47 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Volume volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef (45e630df-9dc9-4bc6-9e59-0f649c7272ef): created successfully Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c095a74-e1b3-48d3-83ce-f661cf5176cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Flow 'volume_create_manager' (926d96d2-338a-4fce-998e-af50de9f8231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:47 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-71c96ad2-744f-41be-b838-16335b1e557a tempest-ProjectMemberTests-670957881 None] Created volume successfully. Jul 23 03:39:47 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 Jul 23 03:39:47 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:47 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22" returned: 0 in 0.366s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:47 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:47 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 Jul 23 03:39:47 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:48 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" returned: 0 in 0.336s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:48 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019 Jul 23 03:39:48 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:48 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22.7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" returned: 0 in 0.259s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019" released by "_delete_snapshot" :: held 1.462s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" released by "delete_snapshot" :: held 1.484s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Creating offline snapshot 9a5b3d20-3a61-49a7-988e-c5e41df82f04 of volume 45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[63afc53f-6694-4d3d-b7c7-208601ffaf69]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Created reservations ['340510a8-1dab-4959-acb3-efbb9215cafc', '495da2d8-1abf-48a7-b222-620237578737', '3df98339-a444-4f3f-8b65-d948370930a7', 'bde43d57-b3ad-465c-a28a-838d300cc197'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:48 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Delete snapshot completed successfully. Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8711cc19-eff1-4c52-9c26-325d4e211a0e tempest-ProjectReaderTests-354028170 None] Lock "cinder-7db0bf0a-f4b0-41f2-bf7d-b16a9ae61019-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:48 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef Jul 23 03:39:48 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:48 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef" returned: 0 in 0.358s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:48 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:48 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 1G Jul 23 03:39:48 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-095762a1-c2c4-49b5-93f5-10ad64907d22-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "cinder-095762a1-c2c4-49b5-93f5-10ad64907d22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db789e-0baa-4d88-a1ff-40e3b423fd97]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:49 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 1G" returned: 0 in 0.424s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:49 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 Jul 23 03:39:49 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:49 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 Jul 23 03:39:49 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:49 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:49 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04" returned: 0 in 0.305s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:49 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 is being set with open permissions: ugo+rw Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:49 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22 Jul 23 03:39:49 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:49 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 Jul 23 03:39:49 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:49 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-095762a1-c2c4-49b5-93f5-10ad64907d22" returned: 0 in 0.287s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-095762a1-c2c4-49b5-93f5-10ad64907d22" released by "delete_volume" :: held 0.715s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:49 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04" returned: 0 in 0.285s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:49 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info Jul 23 03:39:49 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Created reservations ['9dd34d48-310c-43f3-aa42-1f30c0270644', 'a22c0942-e29a-4374-8a09-cbfe2faf2a59', 'ba2d12ad-d32a-40a7-966c-f2891e177b51', 'dc7a1e95-7174-4625-9aa3-4d1ac69786b5'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:50 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:50 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:50 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:50 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info is being set with open permissions: ugo+rw Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:50 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info Jul 23 03:39:50 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:50 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.258s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Deleted volume successfully. Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-970298bf-df04-4a75-8e73-dc147ea8bf58 tempest-ProjectReaderTests-354028170 None] Lock "cinder-095762a1-c2c4-49b5-93f5-10ad64907d22-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:50 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.info" returned: 0 in 0.254s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-eae4c8de-c18d-4d18-aaaf-bd39c13b61d5 tempest-ProjectMemberTests-670957881 None] Create snapshot completed successfully Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-9a5b3d20-3a61-49a7-988e-c5e41df82f04-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-9a5b3d20-3a61-49a7-988e-c5e41df82f04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (5a9b5077-b704-4bee-8591-1cac8f01bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f85ae04-ded5-402f-a3da-5e5deb18ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-9a5b3d20-3a61-49a7-988e-c5e41df82f04" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f85ae04-ded5-402f-a3da-5e5deb18ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437986686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:51Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa3307-8dd3-43cd-aeae-8709e945d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa3307-8dd3-43cd-aeae-8709e945d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4af977a-2d43-4802-a465-6c71330e219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4af977a-2d43-4802-a465-6c71330e219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da', 'volume_name': 'volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3454e8-55e6-4992-b57c-70ea9b1baeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3454e8-55e6-4992-b57c-70ea9b1baeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e1a99a-d7ba-43ca-a617-c8d20eca043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Volume 9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da', 'volume_size': 1} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437986686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:51Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Creating volume 9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:50 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-9a5b3d20-3a61-49a7-988e-c5e41df82f04" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Deleting offline snapshot 9a5b3d20-3a61-49a7-988e-c5e41df82f04 of volume 45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:50 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da 1073741824 Jul 23 03:39:50 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] snapshot_file for this snap is: volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc0fbf-14bd-4eaf-b2c8-f137a8289a0d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:51 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 Jul 23 03:39:51 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:51 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:51 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da 1073741824" returned: 0 in 0.428s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[02abc664-98ee-4938-aa7d-0431ff35c3fa]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:51 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da Jul 23 03:39:51 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:51 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef Jul 23 03:39:51 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:51 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" returned: 0 in 0.256s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e1a99a-d7ba-43ca-a617-c8d20eca043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f2123b-b660-401c-b412-fa68c6debeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:51 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Volume volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da (9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da): created successfully Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f2123b-b660-401c-b412-fa68c6debeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (5a9b5077-b704-4bee-8591-1cac8f01bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:51 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-c2d12bf8-26b2-4d44-81bc-00929fdc384e tempest-ProjectReaderTests-354028170 None] Created volume successfully. Jul 23 03:39:51 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef" returned: 0 in 0.374s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:51 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 Jul 23 03:39:51 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Creating offline snapshot 08c2e8a6-764b-4b6d-add7-e41690b51014 of volume 9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10de556-a428-48f4-bf6e-b5a76f27c527]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:52 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04" returned: 0 in 0.397s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:52 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da Jul 23 03:39:52 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:52 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04 Jul 23 03:39:52 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:52 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef.9a5b3d20-3a61-49a7-988e-c5e41df82f04" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-9a5b3d20-3a61-49a7-988e-c5e41df82f04" released by "_delete_snapshot" :: held 1.482s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:52 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" released by "delete_snapshot" :: held 1.576s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" returned: 0 in 0.394s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:52 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 1G Jul 23 03:39:52 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Created reservations ['3857abf4-4cc7-4c99-90f4-7e10315a6db5', '54ae69c3-f0d3-4cb8-bd9a-b648fef3cb97', '4dd0c7af-4c47-4e88-8e4a-f0217b8da8d6', '549bbaa7-57af-426b-a745-32599652fdf5'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Delete snapshot completed successfully. Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0bca6b68-0ae2-4d1e-9558-d8c7712c5d57 tempest-ProjectMemberTests-670957881 None] Lock "cinder-9a5b3d20-3a61-49a7-988e-c5e41df82f04-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:52 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 1G" returned: 0 in 0.393s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:52 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 Jul 23 03:39:52 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-45e630df-9dc9-4bc6-9e59-0f649c7272ef-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "cinder-45e630df-9dc9-4bc6-9e59-0f649c7272ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Acquiring lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[00989135-df68-455c-a87a-3cde5639be29]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 is being set with open permissions: ugo+rw Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 Jul 23 03:39:53 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef Jul 23 03:39:53 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014" returned: 0 in 0.255s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info Jul 23 03:39:53 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef" returned: 0 in 0.369s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef Jul 23 03:39:53 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info is being set with open permissions: ugo+rw Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info Jul 23 03:39:53 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e630df-9dc9-4bc6-9e59-0f649c7272ef" returned: 0 in 0.247s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "cinder-quobyte-45e630df-9dc9-4bc6-9e59-0f649c7272ef" released by "delete_volume" :: held 0.681s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Created reservations ['2ba86868-dd5b-4a12-b2fa-a2a7dd255ebc', '89903302-27ef-4f96-aa28-48e09dc3380c', '3d83f30d-058b-42c0-925b-bc6135eacf33', '542fe782-588b-4a99-a7f8-39d0d70a021b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:53 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:53 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:53 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.info" returned: 0 in 0.260s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:53 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e924c78f-ad4a-43fa-be5c-dcb5d7f9f490 tempest-ProjectReaderTests-354028170 None] Create snapshot completed successfully Jul 23 03:39:54 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.283s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Deleted volume successfully. Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-08c2e8a6-764b-4b6d-add7-e41690b51014-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-52d676b2-a96a-4025-8315-8bc4669bbd54 tempest-ProjectMemberTests-670957881 None] Lock "cinder-45e630df-9dc9-4bc6-9e59-0f649c7272ef-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-08c2e8a6-764b-4b6d-add7-e41690b51014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-08c2e8a6-764b-4b6d-add7-e41690b51014" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-08c2e8a6-764b-4b6d-add7-e41690b51014" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Deleting offline snapshot 08c2e8a6-764b-4b6d-add7-e41690b51014 of volume 9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] snapshot_file for this snap is: volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c6aa39-7417-4368-b069-bcdf17c46d8e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:54 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 Jul 23 03:39:54 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:54 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014" returned: 0 in 0.392s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[259ea8d6-bc18-4cb9-b1e3-af5f1f2942a9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:54 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da Jul 23 03:39:54 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:55 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" returned: 0 in 0.396s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:55 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 Jul 23 03:39:55 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:55 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014" returned: 0 in 0.365s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:55 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014 Jul 23 03:39:55 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:55 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da.08c2e8a6-764b-4b6d-add7-e41690b51014" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-08c2e8a6-764b-4b6d-add7-e41690b51014" released by "_delete_snapshot" :: held 1.536s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" released by "delete_snapshot" :: held 1.562s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Created reservations ['ebaa317d-8c4e-4273-92cb-40d78e9ad87b', '26a42c9f-275e-46cf-9713-65dbdc58c93a', '3933a0f9-f4dc-417d-9981-d3cc900268e8', '837e1090-d00a-4225-892d-82f6d714a4d5'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Delete snapshot completed successfully. Jul 23 03:39:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-689de67b-d390-47bf-9d0a-078c065f9306 tempest-ProjectReaderTests-354028170 None] Lock "cinder-08c2e8a6-764b-4b6d-add7-e41690b51014-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "cinder-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e82756-8806-4814-852a-b15f62cc199f]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:56 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da Jul 23 03:39:56 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:56 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" returned: 0 in 0.372s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:56 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:56 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da Jul 23 03:39:56 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:57 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" returned: 0 in 0.245s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da" released by "delete_volume" :: held 0.689s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Created reservations ['0547853c-f7ce-4c9f-864f-8cb706eb7a0e', '8ecc67c2-2296-4120-82c8-e1cfc4d28e93', '17f359a6-c7f8-456c-8acc-a833f25e129c', 'b7e3c290-c1e0-49d6-bd69-701d387abf00'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:57 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:39:57 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:57 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:39:57 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Deleted volume successfully. Jul 23 03:39:57 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-ae65bc65-a1eb-4bdc-9417-e9088558cc56 tempest-ProjectReaderTests-354028170 None] Lock "cinder-9c80a3e2-9aed-4d6b-8249-ec5b4c28e9da-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (bf4d0a02-41e1-4776-a249-7c54d13f99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161e034-8eaa-4c22-8a13-aa5eed25f5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161e034-8eaa-4c22-8a13-aa5eed25f5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881329898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18efccf7-0ca5-440f-9e1b-8de6d628f604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:58Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c518a8-47fe-43a8-8d8f-1463d58ec45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c518a8-47fe-43a8-8d8f-1463d58ec45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ae1abf-2ecb-419a-9cfc-9d8b7072d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ae1abf-2ecb-419a-9cfc-9d8b7072d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18efccf7-0ca5-440f-9e1b-8de6d628f604', 'volume_name': 'volume-18efccf7-0ca5-440f-9e1b-8de6d628f604', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ca876b-424b-43dd-af01-95d2b4e465b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ca876b-424b-43dd-af01-95d2b4e465b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f88737-53d2-4b38-9289-da367953b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Volume 18efccf7-0ca5-440f-9e1b-8de6d628f604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18efccf7-0ca5-440f-9e1b-8de6d628f604', 'volume_size': 1} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881329898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18efccf7-0ca5-440f-9e1b-8de6d628f604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:39:58Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Creating volume 18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:39:58 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:58 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 1073741824 Jul 23 03:39:58 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:58 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 1073741824" returned: 0 in 0.403s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:39:58 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 Jul 23 03:39:58 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:39:58 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f88737-53d2-4b38-9289-da367953b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18efccf7-0ca5-440f-9e1b-8de6d628f604', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e638cd-f5d2-45b6-a28f-c6249ed2eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:39:58 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Volume volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 (18efccf7-0ca5-440f-9e1b-8de6d628f604): created successfully Jul 23 03:39:58 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e638cd-f5d2-45b6-a28f-c6249ed2eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:39:59 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (bf4d0a02-41e1-4776-a249-7c54d13f99c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:39:59 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2fe4ef16-4fa0-45f2-bf87-1fbc9a38d129 tempest-ProjectReaderTests-354028170 None] Created volume successfully. Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Creating offline snapshot 7ce5e3f6-7f18-45a4-879d-b99cf604db20 of volume 18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c6e006-f31d-4810-88b1-7726e50be9fb]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:00 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 Jul 23 03:40:00 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:00 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:00 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 1G Jul 23 03:40:00 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:00 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:00 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 1G" returned: 0 in 0.441s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:01 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 Jul 23 03:40:01 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:01 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20" returned: 0 in 0.301s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:01 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 is being set with open permissions: ugo+rw Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:01 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 Jul 23 03:40:01 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:01 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20" returned: 0 in 0.269s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:01 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info Jul 23 03:40:01 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:01 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info" returned: 0 in 0.264s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:01 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info is being set with open permissions: ugo+rw Jul 23 03:40:01 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:01 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info Jul 23 03:40:01 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:02 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.info" returned: 0 in 0.303s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:02 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:02 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-56e88ec8-7e37-4f30-8bca-95d7eef7f9ad tempest-ProjectReaderTests-354028170 None] Create snapshot completed successfully Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-7ce5e3f6-7f18-45a4-879d-b99cf604db20-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-7ce5e3f6-7f18-45a4-879d-b99cf604db20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-7ce5e3f6-7f18-45a4-879d-b99cf604db20" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7ce5e3f6-7f18-45a4-879d-b99cf604db20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Deleting offline snapshot 7ce5e3f6-7f18-45a4-879d-b99cf604db20 of volume 18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] snapshot_file for this snap is: volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9ce00d-ab42-4ad8-a8a7-57aaabeb85cc]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:03 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 Jul 23 03:40:03 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:03 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20" returned: 0 in 0.394s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18efccf7-0ca5-440f-9e1b-8de6d628f604(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3401a1-fb75-40f8-b365-c0eef12e3f66]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:03 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:03 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 Jul 23 03:40:03 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:04 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:04 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 Jul 23 03:40:04 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:04 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20" returned: 0 in 0.368s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:04 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20 Jul 23 03:40:04 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (87b3d3cb-f43a-4d96-8317-73d90013a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2258f4-5912-4241-9746-e13eb2987c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2258f4-5912-4241-9746-e13eb2987c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418886852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9436a8-6765-4d90-9dc1-63583e006572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:05Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd19278d-e4e1-435d-9ab7-f0a93387a21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd19278d-e4e1-435d-9ab7-f0a93387a21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:04 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7bd9bb-6180-4f9d-9be8-c90ef61d5cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7bd9bb-6180-4f9d-9be8-c90ef61d5cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9436a8-6765-4d90-9dc1-63583e006572', 'volume_name': 'volume-bc9436a8-6765-4d90-9dc1-63583e006572', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0006db3-9013-47b0-98b4-5069ca2b6614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0006db3-9013-47b0-98b4-5069ca2b6614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f3e83-cdbb-418b-a945-5457b157cc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:04 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Volume bc9436a8-6765-4d90-9dc1-63583e006572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9436a8-6765-4d90-9dc1-63583e006572', 'volume_size': 1} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418886852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9436a8-6765-4d90-9dc1-63583e006572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:05Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Creating volume bc9436a8-6765-4d90-9dc1-63583e006572 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:04 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604.7ce5e3f6-7f18-45a4-879d-b99cf604db20" returned: 0 in 0.315s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:04 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 1073741824 Jul 23 03:40:04 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-7ce5e3f6-7f18-45a4-879d-b99cf604db20" released by "_delete_snapshot" :: held 1.556s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:04 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" released by "delete_snapshot" :: held 1.583s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Created reservations ['39a5c5ac-8629-4cb0-be95-f30b16a154be', 'bdddfc8b-f3ca-4920-8acd-3b1c6afac676', '3069a4ee-6dfb-41f4-9f5a-5ef49006c438', 'e0d3b708-e867-4382-824d-0fc600418855'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Delete snapshot completed successfully. Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b4454a67-f63e-4861-8fbc-22831a4491a9 tempest-ProjectReaderTests-354028170 None] Lock "cinder-7ce5e3f6-7f18-45a4-879d-b99cf604db20-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:05 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 1073741824" returned: 0 in 0.414s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:05 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 Jul 23 03:40:05 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-18efccf7-0ca5-440f-9e1b-8de6d628f604-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "cinder-18efccf7-0ca5-440f-9e1b-8de6d628f604-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=158,cinder:UPDATE=214,cinder:INSERT=63,cinder:DELETE=20 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:05 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572" returned: 0 in 0.277s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[682313b7-1e19-420b-9be4-80af78239844]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f3e83-cdbb-418b-a945-5457b157cc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9436a8-6765-4d90-9dc1-63583e006572', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b29cd-ab3f-4166-bc4a-61c8c76b68c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=168,cinder:UPDATE=203,cinder:INSERT=52,cinder:DELETE=14 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:40:05 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Volume volume-bc9436a8-6765-4d90-9dc1-63583e006572 (bc9436a8-6765-4d90-9dc1-63583e006572): created successfully Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b29cd-ab3f-4166-bc4a-61c8c76b68c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:05 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (87b3d3cb-f43a-4d96-8317-73d90013a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:05 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2e43d0af-8be8-4fab-97a4-a495486212a2 tempest-ProjectReaderTests-2026965354 None] Created volume successfully. Jul 23 03:40:05 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 Jul 23 03:40:05 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-bc9436a8-6765-4d90-9dc1-63583e006572-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-bc9436a8-6765-4d90-9dc1-63583e006572-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:06 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604" returned: 0 in 0.392s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:06 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604 Jul 23 03:40:06 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-quobyte-bc9436a8-6765-4d90-9dc1-63583e006572" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-bc9436a8-6765-4d90-9dc1-63583e006572" acquired by "delete_volume" :: waited 0.021s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8bf397-fce2-4ef2-9f75-ffcdfaaa5b83]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:06 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 Jul 23 03:40:06 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:06 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-18efccf7-0ca5-440f-9e1b-8de6d628f604" returned: 0 in 0.269s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-18efccf7-0ca5-440f-9e1b-8de6d628f604" released by "delete_volume" :: held 0.723s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Created reservations ['48791f2c-df24-464f-a367-6fb86aa877ec', '9057aaa6-eb16-416b-8ac3-e281887e0790', '3a3ed40c-fcd2-4114-8507-6188617a204a', '57e51fbc-ffb0-4637-95fa-66efc668243f'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:06 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:06 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572" returned: 0 in 0.385s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:06 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:06 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572 Jul 23 03:40:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:06 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.281s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:06 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Deleted volume successfully. Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-dbb19c23-86e7-4e3e-a3f7-25c425c8b799 tempest-ProjectReaderTests-354028170 None] Lock "cinder-18efccf7-0ca5-440f-9e1b-8de6d628f604-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:06 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-bc9436a8-6765-4d90-9dc1-63583e006572" returned: 0 in 0.322s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-bc9436a8-6765-4d90-9dc1-63583e006572" released by "delete_volume" :: held 0.762s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:06 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Created reservations ['34a2d08d-f399-42cd-ba87-fd0dd3eacfae', 'de987796-e4f7-41e0-905e-54f0f34a4ad8', '1f80b807-63b2-430b-90f0-d7d519918e87', '09baddf3-c70c-44ba-adcf-ad02b38e4a7c'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:07 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:07 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:07 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (94d564db-8314-4b46-ad3a-8a52247c6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed14f82-5731-4372-9daa-becd8321593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.306s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:07 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Deleted volume successfully. Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed14f82-5731-4372-9daa-becd8321593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322750013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb4d267-4046-4609-8e14-ed8a323372d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:07Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d0c33d-aec4-40f8-bfd8-57e41a0807c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d0c33d-aec4-40f8-bfd8-57e41a0807c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c984a0-321d-491a-99a1-f2d2e8745077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c984a0-321d-491a-99a1-f2d2e8745077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb4d267-4046-4609-8e14-ed8a323372d0', 'volume_name': 'volume-5fb4d267-4046-4609-8e14-ed8a323372d0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e37403-76cb-4951-9d3e-79514e31b975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e37403-76cb-4951-9d3e-79514e31b975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e3ea66-7310-4890-ae46-b7b48227d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Volume 5fb4d267-4046-4609-8e14-ed8a323372d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb4d267-4046-4609-8e14-ed8a323372d0', 'volume_size': 1} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322750013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb4d267-4046-4609-8e14-ed8a323372d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba0519d6546efbbb1559efc8efe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:07Z,use_quota=True,user_id='375d0913dfe74a6eb0ccdbb3f7edfe82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Creating volume 5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:07 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-73c1be46-2bb7-4522-a380-1db4aa57f5d6 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-bc9436a8-6765-4d90-9dc1-63583e006572-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:07 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 1073741824 Jul 23 03:40:07 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (e9c5ba7d-e19a-4b07-be93-a26c0966ff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b7ff7-98f1-4dc9-9dd0-3ad28cbd7b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300b7ff7-98f1-4dc9-9dd0-3ad28cbd7b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423512502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf13f8c-6d16-4763-b9a9-2f3ff192e7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:08Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45cc0c9-fe45-4abb-8e7d-f82bfa7b7a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45cc0c9-fe45-4abb-8e7d-f82bfa7b7a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df16872-23cf-45ab-aa40-d7ea4cc547dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df16872-23cf-45ab-aa40-d7ea4cc547dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf13f8c-6d16-4763-b9a9-2f3ff192e7d9', 'volume_name': 'volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8761cf-07f8-4095-9147-0cc451ee396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8761cf-07f8-4095-9147-0cc451ee396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17bf970-ab0b-4248-8ff9-ae4f5d5b2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:07 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Volume faf13f8c-6d16-4763-b9a9-2f3ff192e7d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9', 'volume_size': 1} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:07 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 1073741824" returned: 0 in 0.457s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:07 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:07 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 Jul 23 03:40:07 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:08 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0" returned: 0 in 0.250s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423512502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf13f8c-6d16-4763-b9a9-2f3ff192e7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:08Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Creating volume faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:08 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e3ea66-7310-4890-ae46-b7b48227d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb4d267-4046-4609-8e14-ed8a323372d0', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:08 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 1073741824 Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca21d2f-4218-447b-92f7-bd9f02725a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:08 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Volume volume-5fb4d267-4046-4609-8e14-ed8a323372d0 (5fb4d267-4046-4609-8e14-ed8a323372d0): created successfully Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca21d2f-4218-447b-92f7-bd9f02725a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Flow 'volume_create_manager' (94d564db-8314-4b46-ad3a-8a52247c6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-68bef019-c5cc-437e-8ca6-c6bbf632bc39 tempest-ProjectReaderTests-354028170 None] Created volume successfully. Jul 23 03:40:08 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 1073741824" returned: 0 in 0.400s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:08 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 Jul 23 03:40:08 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:08 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" returned: 0 in 0.244s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17bf970-ab0b-4248-8ff9-ae4f5d5b2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538195fb-0688-4af6-9ebf-14e97fb1bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:08 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Volume volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 (faf13f8c-6d16-4763-b9a9-2f3ff192e7d9): created successfully Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538195fb-0688-4af6-9ebf-14e97fb1bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:08 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (e9c5ba7d-e19a-4b07-be93-a26c0966ff8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:08 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-9d8ec104-b852-4deb-9708-83cdb11fced9 tempest-ProjectReaderTests-2026965354 None] Created volume successfully. Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Creating offline snapshot 3b495840-2d45-4c5e-a08e-643d974e4150 of volume 5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e71e4-fa64-43b2-b338-151a06c59a93]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:09 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 Jul 23 03:40:09 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-quobyte-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" acquired by "delete_volume" :: waited 0.022s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:09 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0" returned: 0 in 0.381s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a826375-d946-45a9-83fd-06c5dad29c9c]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:09 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:09 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 1G Jul 23 03:40:09 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 Jul 23 03:40:10 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" returned: 0 in 0.367s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:10 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 1G" returned: 0 in 0.391s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb4d267-4046-4609-8e14-ed8a323372d0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:10 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9 Jul 23 03:40:10 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb4d267-4046-4609-8e14-ed8a323372d0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 Jul 23 03:40:10 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" returned: 0 in 0.252s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9" released by "delete_volume" :: held 0.671s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:10 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb4d267-4046-4609-8e14-ed8a323372d0 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150" returned: 0 in 0.297s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 is being set with open permissions: ugo+rw Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Created reservations ['e0752e91-318f-4bb6-8d78-44ec573a8865', '4839afcb-ac0a-4fe7-9d7a-2fa1185d263f', '28ff5144-15ec-492a-a3c0-727b63ca0c86', '9aea0028-2d78-4ff6-b8b8-9ed5feb1d0f7'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:10 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 Jul 23 03:40:10 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:10 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:10 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:10 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info Jul 23 03:40:10 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:10 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:10 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Deleted volume successfully. Jul 23 03:40:10 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-e0a715c5-9aae-485e-86d5-057f4516aa61 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-faf13f8c-6d16-4763-b9a9-2f3ff192e7d9-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:11 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info" returned: 0 in 0.285s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:11 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info is being set with open permissions: ugo+rw Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:11 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info Jul 23 03:40:11 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:11 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.info" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (c6ea8721-f5a7-48f6-a149-77a882ca4aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1448be48-27d1-4ed3-a350-a01166bbea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:11 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-45a72d9c-45fb-4b1a-85da-40c212ab9434 tempest-ProjectReaderTests-354028170 None] Create snapshot completed successfully Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1448be48-27d1-4ed3-a350-a01166bbea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017595437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b1b24-62fd-4993-9dd1-1893cd8fb95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:11Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc73ec83-8e6b-4bf9-aa96-785bb9344705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc73ec83-8e6b-4bf9-aa96-785bb9344705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e734f92d-e4ed-4177-b42e-aad84c787676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e734f92d-e4ed-4177-b42e-aad84c787676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6b1b24-62fd-4993-9dd1-1893cd8fb95b', 'volume_name': 'volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b4e69b-9e91-43c5-9cd2-e724a65c1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b4e69b-9e91-43c5-9cd2-e724a65c1f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375541d-c2ce-4050-88bd-186e0faecdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:11 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Volume 0b6b1b24-62fd-4993-9dd1-1893cd8fb95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b', 'volume_size': 1} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017595437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b1b24-62fd-4993-9dd1-1893cd8fb95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:11Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Creating volume 0b6b1b24-62fd-4993-9dd1-1893cd8fb95b {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:11 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:11 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b 1073741824 Jul 23 03:40:11 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-3b495840-2d45-4c5e-a08e-643d974e4150-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-3b495840-2d45-4c5e-a08e-643d974e4150-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-3b495840-2d45-4c5e-a08e-643d974e4150" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-3b495840-2d45-4c5e-a08e-643d974e4150" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Deleting offline snapshot 3b495840-2d45-4c5e-a08e-643d974e4150 of volume 5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] snapshot_file for this snap is: volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[70225c8d-91c9-4ce2-b739-02757412df0e]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:11 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:11 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 Jul 23 03:40:11 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:12 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b 1073741824" returned: 0 in 0.450s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:12 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150" returned: 0 in 0.377s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb4d267-4046-4609-8e14-ed8a323372d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:40:12 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b Jul 23 03:40:12 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb6651-d46e-437a-95cd-babef948f746]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:12 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 Jul 23 03:40:12 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:12 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375541d-c2ce-4050-88bd-186e0faecdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a74d31-5d07-4106-b8a5-088a6e2f9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:12 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Volume volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b (0b6b1b24-62fd-4993-9dd1-1893cd8fb95b): created successfully Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a74d31-5d07-4106-b8a5-088a6e2f9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (c6ea8721-f5a7-48f6-a149-77a882ca4aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:12 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-23f7c57b-d5c8-4e0c-9fc8-cc55ed17fc18 tempest-ProjectReaderTests-2026965354 None] Created volume successfully. Jul 23 03:40:12 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0" returned: 0 in 0.364s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:12 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 Jul 23 03:40:12 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:12 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150" returned: 0 in 0.330s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:12 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:12 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150 Jul 23 03:40:12 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:13 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0.3b495840-2d45-4c5e-a08e-643d974e4150" returned: 0 in 0.239s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-3b495840-2d45-4c5e-a08e-643d974e4150" released by "_delete_snapshot" :: held 1.410s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" released by "delete_snapshot" :: held 1.434s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Created reservations ['201e5c01-ab51-44e6-bc02-3a441face04b', 'c9fe5a71-51df-4f6a-a124-f4c8c7197d3a', 'c43e0d86-b973-4659-ab28-a53c977ad60c', '7b86383a-e326-4a75-a44c-5493f3d99b42'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:13 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Delete snapshot completed successfully. Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-95ec5092-3051-4b75-8f6d-90112eb8111d tempest-ProjectReaderTests-354028170 None] Lock "cinder-3b495840-2d45-4c5e-a08e-643d974e4150-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "cinder-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-quobyte-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" acquired by "delete_volume" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3af693-1cf0-482c-b12a-e0dab65ad19a]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:13 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b Jul 23 03:40:13 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-5fb4d267-4046-4609-8e14-ed8a323372d0-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "cinder-5fb4d267-4046-4609-8e14-ed8a323372d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Acquiring lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[92423462-64b9-4e29-96a7-aca81ec159df]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:13 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:14 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" returned: 0 in 0.380s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:14 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b Jul 23 03:40:14 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:14 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 Jul 23 03:40:14 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:14 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" returned: 0 in 0.249s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b" released by "delete_volume" :: held 0.670s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:14 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0" returned: 0 in 0.373s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Created reservations ['99fb1162-76e4-4aff-a941-9312371dbdae', '60f8dae3-e146-411d-9bb3-6eb4a0037348', '4bc66f72-e646-4bad-8f50-3d17dd9a1687', 'f3546967-41e7-49ca-9045-d14dc440b8f8'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:14 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0 Jul 23 03:40:14 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:14 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:14 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:14 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-5fb4d267-4046-4609-8e14-ed8a323372d0" returned: 0 in 0.256s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "cinder-quobyte-5fb4d267-4046-4609-8e14-ed8a323372d0" released by "delete_volume" :: held 0.692s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Created reservations ['ab2c7bc9-f1c1-46c4-8ff3-f23447d8bc19', 'da82b69b-8412-4c4e-b8ff-5dcca19fbb9f', '327b2a43-6b5b-45e3-b16d-608214e16053', '808657d9-7170-4047-844d-8087af8ed4c4'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:14 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.261s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Deleted volume successfully. Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-130844de-4647-4187-b2fb-6d6bf04905df tempest-ProjectReaderTests-2026965354 None] Lock "cinder-0b6b1b24-62fd-4993-9dd1-1893cd8fb95b-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:14 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:14 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:14 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.256s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:14 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:14 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Deleted volume successfully. Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-8651138e-6754-482c-b3b1-e15066f13dd5 tempest-ProjectReaderTests-354028170 None] Lock "cinder-5fb4d267-4046-4609-8e14-ed8a323372d0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (16b3bcd9-751a-4a7d-a1a3-3366c0ee094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b2081f-b0fe-4ee3-a6eb-107ed4fad1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b2081f-b0fe-4ee3-a6eb-107ed4fad1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-265512432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d12e33-7c23-44d0-84d4-3ee610e828cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:15Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f96f621-d0c8-4f62-81d0-13dddad47e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f96f621-d0c8-4f62-81d0-13dddad47e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1ce14c-b4cf-47c5-806a-c2923930efa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1ce14c-b4cf-47c5-806a-c2923930efa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d12e33-7c23-44d0-84d4-3ee610e828cf', 'volume_name': 'volume-43d12e33-7c23-44d0-84d4-3ee610e828cf', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9c18f-0638-434a-ad59-e4d8d074a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9c18f-0638-434a-ad59-e4d8d074a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af00211c-9563-4add-9398-3a34e043b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:15 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Volume 43d12e33-7c23-44d0-84d4-3ee610e828cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d12e33-7c23-44d0-84d4-3ee610e828cf', 'volume_size': 1} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-265512432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d12e33-7c23-44d0-84d4-3ee610e828cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b945b897a4c1fbe4e42f5e4bf0fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:15Z,use_quota=True,user_id='20bf814916a04d968e6077d50700cecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Creating volume 43d12e33-7c23-44d0-84d4-3ee610e828cf {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:15 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:15 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf 1073741824 Jul 23 03:40:15 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:15 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf 1073741824" returned: 0 in 0.431s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:15 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:15 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf Jul 23 03:40:15 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:16 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf" returned: 0 in 0.269s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af00211c-9563-4add-9398-3a34e043b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d12e33-7c23-44d0-84d4-3ee610e828cf', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8252e84-dd2f-471d-bdfc-639ea0b758ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:16 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Volume volume-43d12e33-7c23-44d0-84d4-3ee610e828cf (43d12e33-7c23-44d0-84d4-3ee610e828cf): created successfully Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8252e84-dd2f-471d-bdfc-639ea0b758ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Flow 'volume_create_manager' (16b3bcd9-751a-4a7d-a1a3-3366c0ee094b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:16 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-46b6aed6-cf84-450a-b7b3-c5809e918030 tempest-ProjectReaderTests-2026965354 None] Created volume successfully. Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-43d12e33-7c23-44d0-84d4-3ee610e828cf-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-43d12e33-7c23-44d0-84d4-3ee610e828cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "cinder-quobyte-43d12e33-7c23-44d0-84d4-3ee610e828cf" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-43d12e33-7c23-44d0-84d4-3ee610e828cf" acquired by "delete_volume" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[18316b43-f9a2-4bf2-a7e6-df7d99a542f9]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:16 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf Jul 23 03:40:16 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:16 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf" returned: 0 in 0.378s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:16 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:16 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf Jul 23 03:40:16 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:17 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-43d12e33-7c23-44d0-84d4-3ee610e828cf" returned: 0 in 0.265s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-quobyte-43d12e33-7c23-44d0-84d4-3ee610e828cf" released by "delete_volume" :: held 0.703s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Created reservations ['0a40e7e1-49ae-4bae-8d59-32f0acd435a6', '0229200e-6924-4609-8803-18a3a0ed28ef', '0f14ce52-90b2-4361-98d3-dca12483e169', 'd1dc63c3-8c3f-4887-8498-66ee2e11475b'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:17 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:17 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:17 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.262s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:17 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Deleted volume successfully. Jul 23 03:40:17 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-4b0dc726-92f8-4cdf-b1e3-c6cc9d046c82 tempest-ProjectReaderTests-2026965354 None] Lock "cinder-43d12e33-7c23-44d0-84d4-3ee610e828cf-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:27 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=42,cinder:INSERT=19,cinder:UPDATE=64,cinder:DELETE=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:40:27 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=71,cinder:DELETE=5,cinder:SELECT=47,cinder:INSERT=14 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:35 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:35 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:35 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:36 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:36 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.248s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:36 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:36 devstack cinder-volume[88044]: DEBUG oslo_service.periodic_task [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] Running periodic task VolumeManager._thread_info {{(pid=88044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:40:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread count: 29 {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:40:36 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-b7d433b4-2b69-4408-a11c-aaceba9632a0 None None] thread info: [<_MainThread(MainThread, started 127465108500608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Flow 'volume_create_manager' (58dddea0-8bb3-4d48-b15c-4bd6b0565f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e3f6a-d3d1-457d-91b4-48342c9860c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e3f6a-d3d1-457d-91b4-48342c9860c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1917496237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e011f1-285e-44bf-a009-9f995f8e1788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275c08dbf1e64c15a49a7319f1e79278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:41Z,use_quota=True,user_id='7dfab4569e2143ccb1e983bd25ea31e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bc96dc-ee01-40ec-864a-40098f687669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bc96dc-ee01-40ec-864a-40098f687669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267d24f5-cb45-491e-91ee-4671dde0997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267d24f5-cb45-491e-91ee-4671dde0997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e011f1-285e-44bf-a009-9f995f8e1788', 'volume_name': 'volume-45e011f1-285e-44bf-a009-9f995f8e1788', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8981a2f-f57a-4c9f-9e2b-4057d252376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8981a2f-f57a-4c9f-9e2b-4057d252376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871111cf-fa0c-4f04-bbfe-fe6cf8e7a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:40 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Volume 45e011f1-285e-44bf-a009-9f995f8e1788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e011f1-285e-44bf-a009-9f995f8e1788', 'volume_size': 1} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1917496237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e011f1-285e-44bf-a009-9f995f8e1788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275c08dbf1e64c15a49a7319f1e79278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:41Z,use_quota=True,user_id='7dfab4569e2143ccb1e983bd25ea31e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)}" {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Creating volume 45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:40 devstack cinder-volume[88044]: INFO cinder.volume.drivers.remotefs [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] casted to osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a Jul 23 03:40:40 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 1073741824 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:40 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 1073741824 Jul 23 03:40:40 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:41 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 1073741824" returned: 0 in 0.412s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:41 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:41 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:41 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.241s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'} {{(pid=88044) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871111cf-fa0c-4f04-bbfe-fe6cf8e7a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e011f1-285e-44bf-a009-9f995f8e1788', 'volume_size': 1}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a46ae-39ae-4a12-b670-0158c50b8164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:41 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Volume volume-45e011f1-285e-44bf-a009-9f995f8e1788 (45e011f1-285e-44bf-a009-9f995f8e1788): created successfully Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a46ae-39ae-4a12-b670-0158c50b8164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:41 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Flow 'volume_create_manager' (58dddea0-8bb3-4d48-b15c-4bd6b0565f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:41 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-e81da0d1-fbd5-4729-be07-585f9900a8ea tempest-SnapshotDependencyTests-1777630620 None] Created volume successfully. Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Creating offline snapshot a6e9c733-0694-4bb5-a48d-e50bdade99df of volume 45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef53750-6ed8-4883-bb97-e65999581416]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:42 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:42 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:42 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.356s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df 1G {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:42 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df 1G Jul 23 03:40:42 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:42 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df 1G" returned: 0 in 0.379s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:42 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e011f1-285e-44bf-a009-9f995f8e1788 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:42 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e011f1-285e-44bf-a009-9f995f8e1788 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:42 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:43 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e011f1-285e-44bf-a009-9f995f8e1788 -F qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.300s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:43 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df is being set with open permissions: ugo+rw Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:43 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:43 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:43 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.240s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:43 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info Jul 23 03:40:43 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:43 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:43 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info is being set with open permissions: ugo+rw Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:43 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info Jul 23 03:40:43 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:43 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.info" returned: 0 in 0.241s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:43 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:43 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-4214a60b-dedd-4358-b281-6e3f04478c88 tempest-SnapshotDependencyTests-1777630620 None] Create snapshot completed successfully Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88044) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Flow 'volume_create_manager' (c0c6c388-373b-4e8c-803b-f8a926de1651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839c64d-94fe-468b-8292-4b8021e2decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839c64d-94fe-468b-8292-4b8021e2decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67cedb7-ce85-4ffb-8e38-e7eae21723af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275c08dbf1e64c15a49a7319f1e79278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6e9c733-0694-4bb5-a48d-e50bdade99df,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:40:45Z,use_quota=True,user_id='7dfab4569e2143ccb1e983bd25ea31e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0),volume_type_id=b6d1f4a5-2a3b-4efa-9bae-08afd3ffb3f0)' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3007598d-e3b4-4dcc-8cf0-f52f2295c5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3007598d-e3b4-4dcc-8cf0-f52f2295c5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a93ebe4-8c44-4682-86a4-4d30a991a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a93ebe4-8c44-4682-86a4-4d30a991a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b67cedb7-ce85-4ffb-8e38-e7eae21723af', 'volume_name': 'volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af', 'volume_size': 1, 'snapshot_id': 'a6e9c733-0694-4bb5-a48d-e50bdade99df'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa38608c-dfd0-4dc6-8f51-cd825e260955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa38608c-dfd0-4dc6-8f51-cd825e260955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18fbc6-7985-4c75-ab6f-ce5f70463b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:44 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Volume b67cedb7-ce85-4ffb-8e38-e7eae21723af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af', 'volume_size': 1, 'snapshot_id': 'a6e9c733-0694-4bb5-a48d-e50bdade99df'} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df-b67cedb7-ce85-4ffb-8e38-e7eae21723af" by "_create_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df-b67cedb7-ce85-4ffb-8e38-e7eae21723af" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Creating volume b67cedb7-ce85-4ffb-8e38-e7eae21723af from snapshot a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Selected osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a as target Quobyte volume. {{(pid=88044) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" by "_copy_volume_from_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] snapshot: a6e9c733-0694-4bb5-a48d-e50bdade99df, volume: b67cedb7-ce85-4ffb-8e38-e7eae21723af, {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a93975-f176-4832-97e8-9c43f7eaac5d]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:44 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:45 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:45 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:45 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.340s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e011f1-285e-44bf-a009-9f995f8e1788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Creating direct copy from snapshot {{(pid=88044) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[457980ac-8fc6-4f74-8e26-63826cb39eba]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:45 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:45 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:45 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.347s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG cinder.utils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Path /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af not found in is_blk_device check {{(pid=88044) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:40:45 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:45 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af Jul 23 03:40:45 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:49 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af" returned: 0 in 4.022s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:49 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997a5ac-70f6-44e9-898d-8ff7e91711e1]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:49 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:49 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:49 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:50 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.533s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.image.image_utils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af {{(pid=88044) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:40:50 devstack cinder-volume[88044]: INFO cinder.image.image_utils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Converted 1024.00 MB image at 254.51 MB/s Jul 23 03:40:50 devstack cinder-volume[88044]: WARNING cinder.volume.drivers.remotefs [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af is being set with open permissions: ugo+rw Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:50 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af Jul 23 03:40:50 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:50 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af" returned: 0 in 0.241s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" released by "_copy_volume_from_snapshot" :: held 5.567s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df-b67cedb7-ce85-4ffb-8e38-e7eae21723af" released by "_create_volume_from_snapshot" :: held 5.596s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.610s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18fbc6-7985-4c75-ab6f-ce5f70463b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af', 'volume_size': 1, 'snapshot_id': 'a6e9c733-0694-4bb5-a48d-e50bdade99df'}' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c341ba-0df4-409c-bd98-83003ed14a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:40:50 devstack cinder-volume[88044]: INFO cinder.volume.flows.manager.create_volume [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Volume volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af (b67cedb7-ce85-4ffb-8e38-e7eae21723af): created successfully Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c341ba-0df4-409c-bd98-83003ed14a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88044) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:40:50 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Flow 'volume_create_manager' (c0c6c388-373b-4e8c-803b-f8a926de1651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88044) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:40:50 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-f7ef75d3-0723-4510-84dd-34a03bdd6901 tempest-SnapshotDependencyTests-1777630620 None] Created volume successfully. Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-a6e9c733-0694-4bb5-a48d-e50bdade99df-delete_snapshot" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-a6e9c733-0694-4bb5-a48d-e50bdade99df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" by "delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df" by "_delete_snapshot" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Deleting offline snapshot a6e9c733-0694-4bb5-a48d-e50bdade99df of volume 45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] snapshot_file for this snap is: volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ea19f-6e1c-4c6e-ba32-cc86f8b254e6]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:51 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:51 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:51 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.349s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.remotefs [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e011f1-285e-44bf-a009-9f995f8e1788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88044) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d7018-f99d-46b6-a08b-5396dbed3126]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:51 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:51 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:51 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:52 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.360s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:52 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:52 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:52 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.334s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:52 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df Jul 23 03:40:52 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:52 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788.a6e9c733-0694-4bb5-a48d-e50bdade99df" returned: 0 in 0.240s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-a6e9c733-0694-4bb5-a48d-e50bdade99df" released by "_delete_snapshot" :: held 1.381s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" released by "delete_snapshot" :: held 1.403s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Created reservations ['c4597090-cf10-4110-aa15-96209e94ca93', 'ea8ea353-930c-403c-9168-ec1a448575f4', '25f92b5e-5d17-4547-bf09-861ce638fe97', '7e269ea3-0099-4697-ad7e-c5e47995abd2'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:52 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Delete snapshot completed successfully. Jul 23 03:40:52 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-2eba285c-aacb-4d75-9a62-3dfc99cf38d4 tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-a6e9c733-0694-4bb5-a48d-e50bdade99df-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-45e011f1-285e-44bf-a009-9f995f8e1788-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-45e011f1-285e-44bf-a009-9f995f8e1788-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" acquired by "delete_volume" :: waited 0.015s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917815f-d25f-4941-8888-197d0592c539]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:53 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:53 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:53 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.351s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:53 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:53 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788 Jul 23 03:40:53 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:54 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-45e011f1-285e-44bf-a009-9f995f8e1788" returned: 0 in 0.245s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-45e011f1-285e-44bf-a009-9f995f8e1788" released by "delete_volume" :: held 0.654s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Created reservations ['fcc4c7e9-2758-4b5c-95a5-a66bb9d709c3', '9bec9608-e2bf-45dc-80c1-d1e1b748f8e6', '2d0258cd-570d-4de3-9870-858b887d9098', 'bf967901-b6f0-46b5-b283-8904275c175e'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:54 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:54 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:54 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.251s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:54 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Deleted volume successfully. Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-b392f361-4e2d-4367-b676-53a0f551812f tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-45e011f1-285e-44bf-a009-9f995f8e1788-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-b67cedb7-ce85-4ffb-8e38-e7eae21723af-delete_volume" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-b67cedb7-ce85-4ffb-8e38-e7eae21723af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" by "delete_volume" {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" acquired by "delete_volume" :: waited 0.020s {{(pid=88044) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo.privsep.daemon [-] privsep: reply[13278bc5-0167-4c3f-836e-794dea540960]: (4, 'qcow2') {{(pid=89714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:40:54 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:54 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af Jul 23 03:40:54 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:55 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af" returned: 0 in 0.361s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:55 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af Jul 23 03:40:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:55 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48/volume-b67cedb7-ce85-4ffb-8e38-e7eae21723af" returned: 0 in 0.253s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-quobyte-b67cedb7-ce85-4ffb-8e38-e7eae21723af" released by "delete_volume" :: held 0.652s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.quota [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Created reservations ['89a09ddc-c217-4a31-b395-67590c1bcfd1', 'fc5320f9-a5e9-40bc-94ed-d32a15a0eb3f', '70ebd298-5cc3-4eb1-a29b-e41e75660e43', 'abd73343-71b6-418c-820c-5e11d71ea867'] {{(pid=88044) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a': None} {{(pid=88044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67a9b074-7c73-46ff-900b-7f75834be65a'] {{(pid=88044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:40:55 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48 Jul 23 03:40:55 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:40:55 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG oslo_concurrency.processutils [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d0a02fe55ee29f185e20f0fb963be48" returned: 0 in 0.242s {{(pid=88044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.manager [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Notifying Schedulers of capabilities ... {{(pid=88044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:40:55 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Deleted volume successfully. Jul 23 03:40:55 devstack cinder-volume[88044]: DEBUG cinder.coordination [None req-0aa5f4a3-8710-46c5-82f7-32acc296743a tempest-SnapshotDependencyTests-1777630620 None] Lock "cinder-b67cedb7-ce85-4ffb-8e38-e7eae21723af-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88044) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:41:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:UPDATE=26,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=7 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:41:05 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}